基于前向动力学预测与非对称强化学习的安全导航
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP242;TP18

基金项目:

国家重点研发计划项目 (2024YFB4710400).


A safe navigation method based on forward dynamics prediction and asymmetric reinforcement learning
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对复杂动态环境中感知不完备和传感器噪声导致的动态障碍物预测困难和导航决策不确定性问题, 提出一种融合环境前向动力学预测的非对称强化学习自主导航框架(FANav). 首先, 通过环境前向动力学模型(E-FDM)在训练阶段学习机器人-环境交互的短期状态演化关系, 并在决策优化中引入预测的环境变化和碰撞风险, 引导策略实现前瞻性决策; 在部署阶段, E-FDM基于局部观测和当前动作在线提供短期环境预测, 辅助实时避障决策. 其次, 为应对模型预测误差及感知噪声引发的安全风险, 在执行层引入融合短期风险预测的控制屏障函数(CBF)安全过滤机制, 利用前瞻风险信息在线调节安全约束强度, 并通过二次规划对策略输出进行最小干预修正, 实现形式化安全约束. 最后, 采用非对称近端策略优化框架(PPO), 利用前向预测等特权信息优化价值网络, 以提升策略学习效率和训练稳定性. 实验结果表明, 所提出的方法在避障安全性、决策鲁棒性和运动平滑性方面优于现有对比方法.

    Abstract:

    To address the difficulty of predicting dynamic obstacle states and the increased decision uncertainty caused by incomplete perception and sensor noise in complex dynamic environments, this paper proposes a forward-dynamics-assisted asymmetric reinforcement learning framework for autonomous navigation, termed forward-dynamics-assisted asymmetric navigation (FANav). First, an environment forward dynamics model (E-FDM) is developed to learn the short-term state evolution of robot-environment interactions during training. The predicted environmental changes and collision risks are incorporated into policy optimization to enable anticipatory decision-making. During deployment, the E-FDM provides online short-horizon environmental predictions from local observations and the current action to support real-time obstacle avoidance. Second, to mitigate safety risks caused by prediction errors and sensor noise, a control barrier function (CBF)-based safety filter with short-term risk prediction is introduced at the execution layer. It adaptively adjusts the safety constraint strength using anticipatory risk information and minimally modifies the policy output through quadratic programming, thereby enhancing formal safety enforcement. Finally, an asymmetric proximal policy optimization (PPO) framework is adopted, in which privileged information, including forward predictions, is used to optimize the value network and improve policy learning efficiency and training stability. Experimental results show that the FANav achieves superior obstacle avoidance safety, decision robustness, and motion smoothness compared with existing baselines.

    参考文献
    相似文献
    引证文献
引用本文

范晓亮,刘旭,卜春光,等.基于前向动力学预测与非对称强化学习的安全导航[J].控制与决策,2026,41(11):3232-3244

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-03-13
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-10-16
  • 出版日期: 2026-11-10
文章二维码