基于双分支时空步态特征融合的深度学习步态识别
CSTR:
作者:
作者单位:

石家庄铁道大学 信息科学与技术学院,石家庄 050043

作者简介:

通讯作者:

E-mail: zhangyunzuo888@sina.com.

中图分类号:

TP391.4

基金项目:

国家自然科学基金项目(61702347,62027801);河北省自然科学基金项目(F2017210161,F2022210007); 河北省高等学校科学技术研究项目(ZD2022100);中央引导地方科技发展资金项目(226Z0501G).


Deep learning gait recognition based on two branch spatiotemporal gait feature fusion
Author:
Affiliation:

School of Information Science and Technology,Shijiazhuang Tiedao University,Shijiazhuang 050043,China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对现有步态识别方法易受拍摄视角、着装变化影响的问题,提出一种融合二维无肩姿态拓扑能量图(shoulderless pose topological energy maps,SPTEM)和三维局部骨骼步态特征(local skeleton gait features,LSGF)的深度学习步态识别方法.首先,利用轻量级BlazePose姿态估计算法提取步态视频序列中的人体姿态拓扑图以生成SPTEM,在提高检测速度的同时减弱衣物变化带来的影响;然后,引入LSGF以弥补单一能量图特征在多变视角情况下识别准确率较低的不足;最后,提出结合注意力机制的时空特征提取网络模型,并在全连接层将双流特征进行一致融合.在CASIA-B数据集上对所提出方法进行验证,并与当前主流的步态识别方法进行比较,结果表明,所提出方法在跨视角和穿大衣/棉衣条件下的步态识别率都有明显提升.

    Abstract:

    Aiming at the problem that the existing gait recognition methods are easily affected by shooting angle and clothing changes, this paper proposes a deep learning gait recognition method that fuses 2D shoulderless pose topological energy maps(SPTEMs) and 3D local skeleton gait features(LSGFs). Firstly, the lightweight BlazePose pose estimation algorithm is used to extract the human posture topology in the gait video sequence to generate the SPTEM, which improves the detection speed and reduces the impact of clothing changes. Then, the LSGF is introduced to make up for the low recognition accuracy deficiency of a single energy map feature in the case of variable viewing angles. Finally, a spatio-temporal feature extraction network model fused with an attention mechanism is proposed, and the two-stream features are fused uniformly in the fully connected layer. The proposed algorithm is validated on the CASIA-B dataset and compared with the current mainstream gait recognition methods. The results show that the gait recognition rate of the proposed method is significantly improved under cross-view and cl conditions.

    参考文献
    相似文献
    引证文献
引用本文

张云佐,董旭.基于双分支时空步态特征融合的深度学习步态识别[J].控制与决策,2024,39(4):1403-1408

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2024-03-15
  • 出版日期: 2024-04-20
文章二维码