基于时空建模的多分支Agent Transformer目标跟踪算法
CSTR:
作者:
作者单位:

1.西安科技大学;2.西安科技大学人工智能与计算机学院

作者简介:

通讯作者:

中图分类号:

TP391.4

基金项目:

广西重点研发计划;陕西省教育厅重点科学研究计划项目-重点项目


MBAST:Multi-Branch Agent Transformer Visual Tracking with Spatiotemporal Modeling
Author:
Affiliation:

Fund Project:

Guangxi Key R&D Program;Key Project of the Key Scientific Research Program of the Shaanxi Provincial Department of Education

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对Transformer视觉目标跟踪中局部细节利用不足、计算复杂度与表达能力难以兼顾以及静态模板难以适应目标外观变化等问题,提出一种基于时空建模的多分支Agent Transformer目标跟踪框架MBAST.该方法构建以Agent Transformer为骨干的多分支特征提取网络,在保持全局感受野的同时将注意力计算复杂度由二次增长降低为近似线性增长;设计特征增强模块以强化目标边缘与局部纹理表达;引入动态历史帧更新机制,自适应筛选代表性历史帧以提升长时序外观建模能力;并在特征融合阶段结合边界框几何编码与改进MLP,提升目标定位鲁棒性.GOT-10k和TrackingNet上的实验结果表明,MBAST在多项指标上优于SwinTrack、TATrack等代表性方法,并在背景干扰、目标遮挡和相机运动等复杂场景下表现出较强的稳定性与准确性.

    Abstract:

    To address the issues of insufficient utilization of local details, the difficulty in balancing computational complexity and representation capability, and the inability of static templates to adapt to target appearance variations in Transformer-based visual object tracking, this paper proposes a multi-branch Agent Transformer tracking framework with spatiotemporal modeling, termed MBAST. Specifically, a multi-branch feature extraction network based on Agent Transformer is constructed, which preserves a global receptive field while reducing the computational complexity of attention from quadratic to approximately linear growth. A feature enhancement module is designed to strengthen the representation of target boundaries and local textures. Furthermore, a dynamic historical frame update mechanism is introduced to adaptively select representative frames, thereby improving long-term appearance modeling. In the feature fusion stage, bounding box geometric encoding is combined with an enhanced MLP to improve the robustness of target localization. Experimental results on GOT-10k and TrackingNet demonstrate that MBAST outperforms representative methods such as SwinTrack and TATrack across multiple metrics, and exhibits strong robustness and accuracy in challenging scenarios including background clutter, occlusion, and camera motion.

    参考文献
    相似文献
    引证文献
引用本文
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-01-07
  • 最后修改日期:2026-05-28
  • 录用日期:2026-05-29
  • 在线发布日期: 2026-07-07
  • 出版日期:
文章二维码