The Application Status and Prospect of Deep Reinforcement Learning in the Smart Grid

Authors

  • Jiacheng Sui

DOI:

https://doi.org/10.61173/zgzvnr58

Keywords:

Artificial Intelligence, Big Data, Deep Rein-forcement Learning, Smart Grid

Abstract

Deep reinforcement learning has strong capabilities in data analysis, prediction, and autonomous learning, and it is highly compatible with the demand for big data applications in various aspects of the smart grid. Firstly, this paper summarizes the basic ideas of deep learning, introduces the basic principles and typical algorithms of deep reinforcement learning, and outlines its application characteristics. It reviews the current status of the application of deep reinforcement learning in the smart grid system in aspects such as fault diagnosis, load and new energy power prediction, and power dispatch. In view of the technical characteristics of deep reinforcement learning, combined with the various production links of the power system, an application framework of deep reinforcement learning technology in the power system is established. Finally, the application of deep reinforcement learning is prospected from aspects such as the operation control of multi-energy systems, system security analysis, fault diagnosis of flexible equipment, and privacy information security protection.

References

[1] X. Fang, S. Misra, G. Xue, and D. Yang, “Smart grid—The new and improved power grid: A survey,” IEEE Communications Surveys & Tutorials, vol. 14, no. 4, pp. 944–980, 2012.

[2] T. Wei, Y. Wang, and Q. Zhu, “Deep reinforcement learning for building HVAC control,” in Proc. 54th Annu. Design Autom. Conf. (DAC), 2017, pp. 1–6.

[3] V. Mnih et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, no. 7540, pp. 529– 533, 2015.

[4] J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv preprint, arXiv:1707.06347, 2017.

[5] K. Zhang, A. V. Vasilakos, and Y. Liu, “A decentralized deep reinforcement learning approach for charging multiple electric vehicles,” IEEE Trans. Ind. Inform., vol. 15, no. 12, pp. 6520– 6529, 2018.

[6] Q. Wang, Y. X. Zhou, and F. S. Li, “Deep reinforcement learning-based energy management for a residential microgrid with renewable energy and electric vehicles,” Energy, vol. 196, p. 117081, 2020.

[7] Z. Xu, J. Zhang, and L. Wang, “Intelligent dispatch of integrated energy system based on PPO reinforcement learning algorithm,” Applied Energy, vol. 310, p. 118492, 2022.

[8] L. Han, Y. J. Chen, and F. Gao, “Soft Actor-Critic based scheduling strategy for wind-storage systems under uncertainty,” Energy Reports, vol. 7, pp. 4123–4134, 2021.

[9] W. Zhang, H. Li, and H. W. Liu, “Multi-agent deep reinforcement learning for smart demand response management in microgrids,” IEEE Trans. Smart Grid, vol. 12, no. 4, pp. 3131–3142, 2021.

Downloads

Published

2025-08-26