基于分层强化学习的RRT-connect机械臂路径规划
DOI:
CSTR:
作者:
作者单位:

空军工程大学

作者简介:

通讯作者:

中图分类号:

TP242;TP181

基金项目:

国家自然科学基金项目(面上项目,重点项目,重大项目)


Robotic Arm Path Planning Using Hierarchical Reinforcement Learning with RRT-Connect Algorithm
Author:
Affiliation:

Fund Project:

The National Natural Science Foundation of China (General Program, Key Program, Major Research Plan)

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对双向快速搜索随机树(RRT-Connect)算法在机械臂路径规划中存在的搜索效率低下、路径规划质量不高以及动态环境适应性差等核心问题,提出一种融合分层启发式引导与强化学习的机械臂路径规划算法H-RRT-C。该方法构建多策略协同优化体系:上层利用改进A*算法生成全局粗粒度路径骨架,并采用动态权重机制指导双向搜索树优先采样关键节点,有效减少随机探索的盲目性;下层引入Dijkstra局部搜索机制,依据障碍物分布密度动态调整搜索范围,实现局部路径精细化处理。同时引入双Q网络强化学习策略,设计包含路径长度、节点分布多样性及避障安全性的多目标奖励函数,以实现扩展方向的智能决策。最后,通过MATLAB仿真实验验证了该算法在各种复杂场景中的路径规划效果,并且通过ROS平台以及实体机械臂测试验证了其工程实用性。

    Abstract:

    In response to the core issues of the Bidirectional Rapidly-exploring Random Tree (RRT-Connect) algorithm in robotic arm path planning, such as low search efficiency, poor path quality, and weak adaptability to dynamic environments, this paper proposes a robotic arm path planning algorithm called H-RRT-C, which integrates hierarchical heuristic guidance and reinforcement learning. The method constructs a multi-strategy collaborative optimization system: the upper layer uses an improved A* algorithm to generate a global coarse-grained path skeleton, and adopts a dynamic weight mechanism to guide the bidirectional search tree to preferentially sample key nodes, effectively reducing the blindness of random exploration; the lower layer introduces a Dijkstra local search mechanism, which dynamically adjusts the search range according to the distribution density of obstacles to achieve fine-grained processing of local paths. At the same time, a double Q-network reinforcement learning strategy is introduced, and a multi-objective reward function including path length, node distribution diversity, and obstacle avoidance safety is designed to realize intelligent decision-making for the expansion direction.Finally, MATLAB simulation experiments verify the path planning effectiveness of this algorithm in various complex scenarios, and tests conducted on a ROS platform and a physical robotic arm validate its engineering practicality.

    参考文献
    相似文献
    引证文献
引用本文
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-09-30
  • 最后修改日期:2026-01-21
  • 录用日期:2026-01-22
  • 在线发布日期:
  • 出版日期:
文章二维码