基于通道信息对齐的素描行人重识别
CSTR:
作者:
作者单位:

昆明理工大学 信息工程与自动化学院,昆明 650500

作者简介:

通讯作者:

E-mail: shentao@kmust.edu.cn.

中图分类号:

TP273

基金项目:

国家自然科学基金项目(61671225,61971208,61702128);云南省应用基础研究计划重点项目(2018 FA043);云南省中青年学术技术带头人后备人才项目(2019HB005);云南省万人计划青年拔尖人才项目(2018 73).


Channel information alignment for sketch re-identification
Author:
Affiliation:

School of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    素描行人重识别任务要求在彩色图像库中寻找与给定素描图像相同身份的行人.由于行人的素描图像与彩色图像之间的姿态、视角等信息不同,两个模态在相同的空间位置往往具有不同的语义信息,导致所提取的特征不具备鲁棒性.以往的研究着重于行人不随着模态信息变化的特征提取,而忽略了不同模态间语义不对齐的问题,进而导致最终编码的特征受到摄像机视角、人体姿态或者遮挡等干扰,不利于图像的匹配.对此,提出基于通道信息对齐的素描行人重识别模型.其中:语义信息一致性学习模块引导网络在特征的相同通道上形成固定编码的语义信息,降低语义信息不对齐所带来的影响;差异性特征注意力模块辅助网络编码具有差异性的身份相关信息,并设计空间差异正则化项以防止网络仅关注局部特征.两个模块互相配合,强化网络对语义信息的感知和对齐.所提出的方法在具挑战性数据集Sketch Re-ID、QMUL-ShoeV2上的rank-1和mAP分别达到60.0%和59.3%、33.5%和46.1%,从而验证了所提出方法的有效性.

    Abstract:

    The sketch person re-identification requires to search for pedestrians with the same identity as the given sketch image in the color image gallery. Due to the difference of posture and viewpoint between the sketch image and the color image, the two images from two different modes often have different semantic information in the same spatial position, which leads to the lack of robustness of the extracted features. Previous studies focus on pedestrian feature extraction modal-invariant information, but ignore the issue of semantic misalignment between different modal images, which leads to features interference by camera viewpoint, human posture or occlusion, and it is not good for image matching. The sketch pedestrian re-identification model based on channel information alignment is proposed, in which the semantic information alignment learning module guides the network to code semantic information on the same channel of the feature, thus reducing the impact of misalignment of semantic information. Among them, the variant feature attention module assists the network to encode the variant identity related information, and designs the spatial variant regularization term to prevent the network from only paying attention to local features. The two modules cooperate with each other to strengthen the network's perception and alignment of semantic information. The rank-1and mAP of the proposed method in the challenging data sets Sketch Re-ID and QMUL-ShoeV2 reach 60.0% and 59.3%, 33.5% and 46.1%, respectively, which verifies the effectiveness of the proposed method.

    参考文献
    相似文献
    引证文献
引用本文

李艳,沈韬,曾凯.基于通道信息对齐的素描行人重识别[J].控制与决策,2022,37(12):3129-3138

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2022-11-17
  • 出版日期: 2022-12-20
文章二维码