1.河南科技大学;2.东北大学

TP181

Multi-Step Sarsa Control Algorithm Based on RBF Neural Network
Author:
Affiliation:

1.Henan University of Science and Technology;2.Northeastern University

Fund Project:

• 摘要
• |
• 图/表
• |
• 访问统计
• |
• 参考文献
• |
• 相似文献
• |
• 引证文献
• |
• 资源附件
• |
• 文章评论
摘要:

Abstract:

For model-free nonlinear system with continuous state space, a multi-step reinforcement learning control algorithm based on RBF neural network is proposed in this paper. Firstly, the neural network is introduced to reinforcement learning system for approximating state-action value function, which is a common solution to the problem of continuous state space expression in reinforcement learning. Then, combined with the eligibility trace mechanism，multi-step algorithm Sarsa($\lambda$) is formed to improve the learning efficiency of the system by recording the experienced states. Finally, softmax strategy is improved by decayed temperature parameter, so as to optimize the selection probability of actions and balance the relationship between exploration and exploitation. The simulation results of MountainCar task show that the proposed algorithm can effectively achieve the model-free control task of continuous nonlinear system through fewer times of training. Compared with the single-step algorithm, the multi-step algorithm takes less average convergent steps to complete the task and perform more stable, which proves that the combination of nonlinear value function approximation and multi-step algorithm has good performance in the control task.

参考文献
相似文献
引证文献

• 点击次数:
• 下载次数:
• HTML阅读次数:
• 引用次数:
历史
• 收稿日期:2021-10-09
• 最后修改日期:2021-12-29
• 录用日期:2021-12-30
• 在线发布日期: 2022-02-01
• 出版日期: