基于多目标深度强化学习的需求响应式列车时刻表优化
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

U292.4

基金项目:

国家自然科学基金项目(72361020).


Optimization of demand-responsive train timetabling based on multi-objective deep reinforcement learning
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    客流在时空维度上呈现的时变特性对城市轨道交通运营管理提出了严峻挑战, 同时, 需求响应式列车时刻表优化问题的复杂性对算法设计提出了更高的要求. 为此, 将人工智能领域的深度强化学习方法应用于地铁列车时刻表的优化问题, 以提升地铁运营管理的智能化水平. 首先, 将时变客流需求与列车时刻表决策互动关系构建为马尔可夫决策过程, 为智能体提供训练和学习环境. 其中: 以乘客服务、列车运量以及列车运行作为状态空间, 以列车发车间隔作为动作空间, 并设计“人-车-站”一体化的多维复合奖励函数. 然后, 开发一种基于自适应发车间隔和列车数量的多目标软演员-评论家算法来提升求解效率. 接着, 以小规模算例进行超参数优化, 并验证需求响应式列车时刻表相对于均衡列车时刻表的优势. 最后, 以广州市地铁8号线进行仿真实验, 实验结果表明, 所提出方法相对于其他人工智能方法以及启发式算法具有较快的收敛速度和求解效率. 此外, 针对不同客流扰动场景, 所提出方法能够在短时间内生成满意的运营方案, 表明所提出方法具有较好的泛化能力. 研究结果可为进一步提升地铁运营调度智能化水平提供理论和方法支撑.

    Abstract:

    The time-varying characteristics of passenger flow in spatial and temporal dimensions impose significant challenges on urban rail transit operation management, while the complexity of demand-responsive train timetabling calls for more advanced algorithmic solutions. To address this, this paper introduces a deep reinforcement learning (DRL) approach to optimize subway train schedules, thereby improving the intelligence of operational management. The dynamic interaction between time-varying passenger demand and train timetable is formulated as a Markov decision process, which serves as a training environment for the learning agent. The state space includes passengers service, train capacity and train operation, and the action space is defined by dispatch intervals. A multi-dimensional reward function jointly considers passengers, trains, and stations. A multi-objective soft actor-critic algorithm with adaptive dispatch intervals and train numbers is developed for efficient optimization. Hyper-parameter tuning via a small-scale case confirms that demand-responsive timetable outperforms fixed-interval timetable. Simulations on Guangzhou Metro Line 8 show faster convergence and higher solution efficiency compared to other AI and heuristic methods. Moreover, under various passenger flow disturbance scenarios, the proposed method can generate satisfactory operation plans in a short period of time, demonstrating its strong generalization capability. These results provide theoretical and methodological support for intelligent subway scheduling.

    参考文献
    相似文献
    引证文献
引用本文

高如虎,刘伟,焦治铎.基于多目标深度强化学习的需求响应式列车时刻表优化[J].控制与决策,2026,41(11):3040-3052

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-12-25
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2026-10-16
  • 出版日期: 2026-11-10
文章二维码