Development of the Big Data Management System on National Virtual Power Plant

Abstract

We are developing the Business Platform for demand side management in energy sector. This paper introduces the Business Platform and describes the development of the pilot platform and main components. In addition, main applications such as Automated Demand Response (AutoDR) and Monitoring Based Commissioning (MBCx) is introduced. One of main components of the platform is the Big Data Management System to save and analyze the energy big data. We constructed two big data cluster systems: one is a Hadoop cluster and the other is the one Spark installed. We also implemented software modules to collect and generate the energy big data. The data flow inside the platform is presented and implementation of Application Programing Interfaces (APIs) to access the big data is described. Furthermore, we developed various applications on top of the platform using the APIs. Among those, this paper presents the monitoring service.