基于强化学习的倒立摆控制仿真实验系统

A Simulation Experimental System for Inverted Pendulum Control Based on Reinforcement Learning

  • 摘要: 为加强强化学习在自动化相关专业的实践教学、提升学生对强化学习算法基本原理的理解与实践,设计了一套直线一阶倒立摆强化学习仿真实验教学系统。基于MWORKS平台构建直线一阶倒立摆系统的强化学习环境及状态空间、动作空间和奖励函数,实现DQN、PPO和DDPG等典型强化学习算法,并具备人机交互界面。系统具备参数配置、智能体训练、训练过程可视化、训练结果分析和控制响应显示等功能,可对不同算法的累计奖励、稳定运行步数和控制响应曲线进行对比分析。该系统能够支撑强化学习控制的定性直观理解和定量分析评价,有助于提升学生对强化学习基本原理的掌握和学习兴趣,可为智能控制课程实验教学提供参考。

     

    Abstract: To strengthen practical teaching of reinforcement learning in automation specialty and improve students’ understanding and application of its basic principles, a simulation experimental teaching system is designed for a linear first-order inverted pendulum based on reinforcement learning control. Based on the MWORKS platform, a reinforcement learning environment is constructed for the linear first-order inverted pendulum system, including the state space, action space, and reward function. Typical reinforcement learning algorithms, including DQN, PPO, and DDPG, are implemented, and designed a human-machine interaction interface. The system provides functions such as parameter configuration, agent training, training process visualization, training result analysis, and control response display. It can be used to compare and analyze the cumulative rewards, stable running steps, and control response curves of different algorithms. The system supports qualitative and intuitive understanding as well as quantitative analysis and evaluation of reinforcement learning control, helps students master the basic principles of reinforcement learning and enhance their learning interest, and provides a reference for experimental teaching in intelligent control courses.

     

/

返回文章
返回