Andes_gym: A Versatile Environment for Deep Reinforcement Learning in Power Systems

2022/03/02 by Cui, Hantao, Zhang, Yichen · 1 citation
#FOS: Electrical engineering #Systems and Control (eess.SY) #electronic engineering #information engineering

paper · doi:10.48550/arxiv.2203.01292

Abstract

This paper presents Andes_gym, a versatile and high-performance reinforcement learning environment for power system studies. The environment leverages the modeling and simulation capability of ANDES and the reinforcement learning (RL) environment OpenAI Gym to enable the prototyping and demonstration of RL algorithms for power systems. The architecture of the proposed software tool is elaborated to provide the observation and action interfaces for RL algorithms. An example is shown to rapidly prototype a load-frequency control algorithm based on RL trained by available algorithms. The proposed environment is highly generalized by supporting all the power system dynamic models available in ANDES and numerous RL algorithms available for OpenAI Gym.

Cited by

• Quantum-Accelerated Deep Reinforcement Learning for Frequency Regulation Enhancement

Related

• Reinforcement Learning for Electricity Network Operation
• RL2Grid: Benchmarking Reinforcement Learning in Power Grid Operations
• Design and implementation of an environment for Learning to Run a Power Network (L2RPN)
• PowerGridworld: A Framework for Multi-Agent Reinforcement Learning in Power Systems
• CommonPower: A Framework for Safe Data-Driven Smart Grid Control