一种鲁棒高效的改进多智能体深度确定性策略梯度算法
CSTR:
作者:
作者单位:

华东交通大学

作者简介:

通讯作者:

中图分类号:

TP273

基金项目:


A Robust and Efficient Improved Multi-Agent Deep Deterministic Policy Gradient Algorithm
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    多智能体强化学习面临鲁棒探索与高效协作的双重挑战。现有算法探索机制多为固定或与状态无关的调节方式,忽视了不同决策情境下差异化的探索需求,导致难以维持探索与利用的有效平衡;同时,在处理智能体间关系时通常采用扁平化的信息聚合方式,忽略了其内在的交互拓扑结构。为应对这些挑战,本文提出了一种基于状态自适应最大熵与图注意力网络的多智能体深度确定性策略梯度算法。首先,构建了最大熵强化学习框架,通过设计一个状态依赖的温度系数作为策略熵的自适应权重,使智能体能够根据当前的实时交互状态与探索需求动态调整策略的探索强度,从而实现自适应的探索-利用平衡。其次,利用图注意力网络显式地建模智能体间的交互拓扑关系,通过注意力机制区分不同邻居的重要性,生成更具表达力的状态表征以增强智能体间的协作。在多智能体仿真环境中的实验结果表明,本文算法在学习效率和最终协作性能方面都体现了较大的优越性。

    Abstract:

    Multi-agent reinforcement learning faces dual challenges of robust exploration and efficient collaboration.Existing algorithms predominantly employ fixed or state-independent exploration mechanisms,neglecting the differentiated exploration needs across diverse decision contexts.This hinders the maintenance of an effective balance between exploration and exploitation.Simultaneously,they typically adopt a flattened information aggregation approach when handling agent relationships,overlooking their inherent interactive topological structure.To address these challenges,this paper proposes a multi-agent deep deterministic policy gradient algorithm based on state-adaptive maximum entropy and graph attention networks.First,a maximum entropy reinforcement learning framework is constructed.By designing a state-dependent temperature coefficient as an adaptive weight for policy entropy,agents dynamically adjust exploration intensity according to real-time interaction states and exploration needs,achieving adaptive exploration-exploitation balance.Second,a graph attention network explicitly models the interactive topology among agents.By distinguishing the importance of different neighbors through attention mechanisms,it generates more expressive state representations to enhance inter-agent collaboration.Experimental results in multi-agent simulation environments demonstrate that the proposed algorithm exhibits significant superiority in both learning efficiency and final collaborative performance.

    参考文献
    相似文献
    引证文献
引用本文
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-12-23
  • 最后修改日期:2026-07-26
  • 录用日期:2026-07-27
  • 在线发布日期: 2026-09-03
  • 出版日期:
文章二维码