势博弈深度强化学习驱动的AGV群能量均衡研究
CSTR:
作者:
作者单位:

上海海事大学

作者简介:

通讯作者:

中图分类号:

F402

基金项目:

国家自然科学基金项目(面上项目,重点项目,重大项目)


Energy Balance of AGVs Driven by Potential Game Deep Reinforcement Learning
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    港口智慧绿色转型背景下,自动导引车(AGV)成为自动化集装箱码头水平运输的主力.针对AGV群电量和充电资源利用不均衡问题,本文基于势博弈和深度强化学习算法开展AGV群能量均衡研究.考虑AGV群体电量水平、电量分布范围、充电站利用情况问题,将分布式AGV充电调度问题转化为AGV之间的博弈模型,提出一种基于势博弈的AGV群能量均衡模型;将多智能体深度确定性策略梯度(MADDPG)算法与势博弈(PGT)融合,提出MADDPG-PGT算法,求解AGV群能量均衡策略.结合3艘实际船舶任务,进行数值仿真实验.仿真结果表明:无论自动化码头作业处于高峰和低谷时段,本文方法在任务执行期间AGV群电量水平控制在85%左右,电量分布范围控制在80%-90%,达到AGV群能量均衡状态,降低了充电站的充电服务压力;方法对比显示,所提方法在AGV群能量均衡程度、任务完成时效和充电桩利用率方面表现更优.垂直/U型/水平布局下,MADDPG-PGT算法都可使AGV群达到能量均衡状态,其中在小规模和大规模任务量时,水平布局的能量均衡状态最优,在中规模任务量时,三种布局均衡状态相仿,均提升了自动化码头整体效益.

    Abstract:

    Under the background of smart and green transformation in ports, Automated Guided Vehicles (AGVs) have become the main means of horizontal transportation in automated container terminals. To address the problem of unbalanced energy levels and inefficient utilization of charging resources among AGV groups, this paper investigates AGV group energy balancing based on potential game theory and deep reinforcement learning. Considering the AGV group energy level, energy distribution range, and charging station utilization, the distributed AGV charging scheduling problem is transformed into a game-theoretic model among AGVs, and a potential game–based AGV group energy balancing model is proposed. Furthermore, by integrating the Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm with Potential Game Theory (PGT), a MADDPG-PGT algorithm is developed to derive the energy balancing strategy for AGV groups. Numerical simulation experiments are conducted based on the operational tasks of three real container vessels. The simulation results indicate that, regardless of whether the automated container terminal operates during peak or off-peak periods, the proposed method maintains the average energy level of the AGV group at approximately 85%, while constraining the energy distribution range within 80%–90% throughout task execution. This achieves a balanced energy state for the AGV group and effectively reduces the service pressure on charging stations. Comparative results demonstrate that the proposed method outperforms existing approaches in terms of AGV group energy balance, task completion time, and charging station utilization. Under vertical, U-shaped, and horizontal layouts, the MADDPG-PGT algorithm consistently achieves energy balance among AGV groups. Specifically, for small-scale and large-scale task volumes, the horizontal layout yields the best energy balancing performance, while for medium-scale task volumes, the three layouts exhibit similar equilibrium states, collectively enhancing the overall operational efficiency of automated container terminals.

    参考文献
    相似文献
    引证文献
引用本文
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-11-17
  • 最后修改日期:2026-05-19
  • 录用日期:2026-05-21
  • 在线发布日期: 2026-06-11
  • 出版日期:
文章二维码