A semi-automated approach to validation and error diagnostics of water network data

Jonas Kjeld Kirstein*, Klavs Høgh, Martin Rygaard, Morten Borup

*Corresponding author for this work

    Research output: Contribution to journalJournal articleResearchpeer-review

    178 Downloads (Pure)

    Abstract

    We propose a method for quality assurance of raw data from water distribution networks in near real-time. Well-known and novel data analysis methods, including a timestamp drift test, are combined to produce a malfunction indicator database for diagnosing anomalies within data acquisition practices. The method was applied to 112 flow and 111 pressure data sets, covering on average 32 months, located throughout the distribution networks of three Danish utilities. Around 10% of measurements in the utilities’ meter data sets were absent and 3–35% were categorized as dubious or erroneous. The most common types of anomalies for flow and pressure data were flatline and time stamp inconsistencies. Time drifts were identified in all three utilities and a similarity analysis revealed a simultaneous occurrence of many anomalies. These high rates could have been avoided if the proposed method had been implemented to automatically highlight meter errors and system-wide problems in data collection.
    Original languageEnglish
    JournalUrban Water Journal
    Volume16
    Issue number1
    Pages (from-to)1-10
    ISSN1573-062X
    DOIs
    Publication statusPublished - 2019

    Keywords

    • Data validation
    • error diagnostics
    • water supply

    Fingerprint

    Dive into the research topics of 'A semi-automated approach to validation and error diagnostics of water network data'. Together they form a unique fingerprint.

    Cite this