基于并行多外观特征的孪生网络目标跟踪算法
CSTR:
作者:
作者单位:

1. 燕山大学 智能控制系统与智能装备教育部工程研究中心,河北 秦皇岛 066004;2. 燕山大学 工业计算机控\hspace{13pt}制工程河北省重点实验室,河北 秦皇岛 066004;3. 燕山大学 电力电子节能与传动控制河北省重点实验室,\hspace{13pt}河北 秦皇岛 066004;4. 燕山大学 电气工程学院,河北 秦皇岛 066004

作者简介:

通讯作者:

E-mail: czwaaron@ysu.edu.cn.

中图分类号:

TP391.4

基金项目:

国家自然科学基金项目(61573305);河北省自然科学基金项目(F2022203038,F2019203511).


Tracking algorithm of Siamese network based on parallel multiple appearance features
Author:
Affiliation:

1. Engineering Research Center of the Ministry of Education for Intelligent Control System and Intelligent Equipment,Yanshan University,Qinhuangdao 066004,China;2. Key Laboratory of Industrial Computer Control Engineering of Hebei Province,Yanshan University,Qinhuangdao 066004,China;3. Key Lab of Power Electronics for Energy Conservation and Motor Drive of Hebei Province,Yanshan University,Qinhuangdao 066004,China;4. School of Electrical Engineering,Yanshan University,Qinhuangdao 066004,China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    目标跟踪通常只能使用视频第1帧的外观信息,在线学习目标的外观特征,并预测后续帧中该目标的位置和大小.然而,跟踪过程中目标外观时刻变化,仅通过第1帧并不能准确描述后续目标的外观.针对上述问题,提出一种基于并行多外观特征的孪生网络目标跟踪算法.首先,引入包含目标近期外观信息的动态模板帧,同时提出3种方法:多外观特征、并行外观特征、并行多外观特征,利用动态模板帧进行目标跟踪.与简单地使用动态模板帧替换初始模板帧不同,所提出的方法可解决由动态模板帧中目标容易漂移导致的跟踪算法性能下降的问题.其次引入评价模块,使用基于信息熵的评价方法或基于IOU-Net的评价方法,对得到的多个预测结果分别进行打分,选择得分最高的预测结果作为最终的预测结果.最后提出更新模块,对评价模块得到的得分进行分析,当得分满足更新模块设立的更新条件时,用最终的预测结果更新动态模板帧,使用新的外观信息指导下一帧跟踪.实验结果显示,该算法在GOT-10k、OTB100等标准数据集上取得较好效果,验证了所提算法的有效性.

    Abstract:

    Target tracking usually only uses the appearance information of the first frame of the video to obtain the appearance characteristics of the target online, and predict the position and size of the target in subsequent frames. However, the appearance of the target changes all the time during the tracking process, and the appearance of subsequent targets is not be accurately described by the first frame alone. Focusing on the above problems, this paper proposes a Siamese network target tracking algorithm based on parallel multi-appearance features. First, dynamic template frames containing information about the recent appearance of the target are introduced. At the same time, three methods of multi-appearance, parallel appearance and parallel multi-appearance are proposed, which make dynamic template frames for target tracking. Second, either the evaluation strategy of information entropy or the evaluation method of the neural network in the evaluation module is applied to score the obtained multiple predictions separately, and the prediction result with the highest score is selected as the final prediction result. Finally, an update module is proposed to analyse the scores obtained from the evaluation module. If the score meets the update conditions set by the update module, the final prediction result is used to update the dynamic template frame, and the new appearance information is used to guide the tracking of the next frame. The experimental results show that the algorithm achieves good results on standard datasets such as GOT-10k, OTB100, which verif the effectiveness of the proposed algorithm.

    参考文献
    相似文献
    引证文献
引用本文

陈志旺,孙泽兵,吕昌昊,等.基于并行多外观特征的孪生网络目标跟踪算法[J].控制与决策,2024,39(11):3628-3636

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-09-20
  • 出版日期: 2024-11-20
文章二维码