Integrating deep reinforcement learning into home energy management system based on soft actor-critic framework

Conference: ECITech 2022 - The 2022 International Conference on Electrical, Control and Information Technology
03/25/2022 - 03/27/2022 at Kunming, China

Proceedings: ECITech 2022

Pages: 6Language: englishTyp: PDF

Authors:
Tan, Zhukui (School of Economics and Management, North China Electric Power University, Changping Beijing, China & Electric Power Research Institute of Guizhou Power Grid Co., Ltd, Guiyang Guizhou, China)
Zeng, Ming (School of Economics and Management, North China Electric Power University, Changping Beijing, China)
Liu, Bin; Feng, Shengyong (Electric Power Research Institute of Guizhou Power Grid Co., Ltd, Guiyang Guizhou, China)
Peng, Binggang (Beijing Tsingsoft Innovation Technology Co. Ltd Beijing, China)

Abstract:
This paper proposes a two-layer home energy management model (HEMS) based on soft actor-critic (SAC) to deal with the uncertainty and complexity of family environment change. Firstly, the scheduling problem in home energy management is transformed into a Markov decision process, and the method of deep reinforcement learning is introduced to solve it. Then, the SAC method is introduced to solve the model. The first layer forms the economic scheduling of household schedulable load on the premise of ensuring comfort, and the second layer optimizes the charging and discharging process of energy storage device on the basis of the decision-making of the first layer, so as to further save the power cost. Finally, the household load public dataset REDD is used for verification. Experimental results show that the proposed method has better performance and computational efficiency.