基于脉冲强化学习和CPG的四足机器人分层运动控制
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP242.6

基金项目:

国家自然科学基金项目(12272092, 12332004).


Hierarchical motion control of quadruped robot based on spiking reinforcement learning and CPG
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着四足机器人控制技术的逐渐发展, 四足机器人已经广泛被应用于救援、军事、探险等领域. 在四足机器人的应用中, 如何在不牺牲控制性能的前提下有效降低能耗是一个重要的瓶颈问题. 为此, 提出一种基于脉冲强化学习算法(SRL)和中枢模式发生器(CPG)的分层控制算法(SRL-CPG)用于四足机器人的运动控制. 首先, 因为脉冲神经元相比传统的人工神经元具有更低的能耗, 故基于脉冲神经网络(SNN)构建脉冲强化学习算法, 将其作为控制中枢; 其次, 在控制任务动作空间过大的情况下, SRL难以取得良好的控制效果, 因此将CPG作为低级控制器, 利用SRL接受状态信息并对CPG参数进行调整进而控制四足机器人运动; 最后, 将SRL-CPG控制算法在Webots环境中搭建的四足机器人模型Gbot上进行实验验证, 结果表明SRL-CPG控制算法能够有效应用于四足机器人的运动控制, 并大大降低能耗.

    Abstract:

    The control technology of quadruped robots has gradually developed, and quadruped robots have been widely applied in fields such as rescue, military, and exploration. In the application of quadruped robots, how to effectively reduce energy consumption without sacrificing control performance is an important bottleneck problem. In response to this problem, this paper proposes a hierarchical control algorithm based on the spiking reinforcement learning(SRL) algorithm and the central pattern generator(CPG). First, considering that spiking neurons have lower energy consumption than traditional artificial neurons, this paper constructs a SRL algorithm based on a spiking neural network(SNN) and uses it as the control center. Then, when the action space of the control task is too large, it is difficult for the SRL algorithm to achieve good control effects, thus the CPG model is used as the low-level controller, and the SRL algorithm is utilized to accept state information and adjust CPG parameters for controlling the movement of the quadruped robot. Finally, the SRL-CPG control algorithm is experimentally verified on the quadruped robot model Gbot built in the Webots environment. The results show that the SRL-CPG control algorithm can be effectively applied to the motion control of quadruped robots and significantly reduce energy consumption.

    参考文献
    相似文献
    引证文献
引用本文

肖云发,韩芳,王青云.基于脉冲强化学习和CPG的四足机器人分层运动控制[J].控制与决策,2025,40(7):2070-2078

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-08-29
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2025-06-05
  • 出版日期: 2025-07-20
文章二维码