Streamlining Smart Meter Data Analytics

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedings – Annual report year: 2015Researchpeer-review


View graph of relations

Today smart meters are increasingly used in worldwide. Smart meters are the advanced meters capable of measuring customer energy consumption at a fine-grained time interval, e.g., every 15 minutes. The data are very sizable, and might be from different sources, along with the other social-economic metrics such as the geographic information of meters, the information about users and their property, geographic location and others, which make the data management very complex. On the other hand, data-mining and the emerging cloud computing technologies make the collection, management, and analysis of the so-called big data possible. This can improve energy management, e.g., help utilities improve the management of energy and services, and help customers save money. As this regard, the paper focuses on building an innovative software solution to streamline smart meter data analytic, aiming at dealing with the complexity of data processing and data analytics. The system offers an information integration pipeline to ingest smart meter data; scalable data processing and analytic platform for pre-processing and mining big smart meter data sets; and a web-based portal for visualizing data analytics results. The system incorporates hybrid technologies, including big data technologies Spark and Hive, the high performance RDBMS PostgreSQL with the in-database machine learning toolkit, MADlib, which are able to satisfy a variety of requirements in smart meter data analytics.
Original languageEnglish
Title of host publicationProceedings of the 10th Conference on Sustainable Development of Energy, Water and Environment Systems
Number of pages14
PublisherInternational Centre for Sustainable Development of Energy, Water and Environment Systems
Publication date2015
Publication statusPublished - 2015
Event10th Conference on Sustainable Development of Energy, Water and Environment Systems - Dubrovnik, Croatia
Duration: 27 Sep 20152 Oct 2015
Conference number: 10


Conference10th Conference on Sustainable Development of Energy, Water and Environment Systems
Internet address


Download as:
Download as PDF
Select render style:
Download as HTML
Select render style:
Download as Word
Select render style:

Download statistics

No data available

ID: 110737588