面向医学图像分割的双通道特征感知网络
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391.41

基金项目:

江苏省研究生科研与实践创新计划项目(SJCX24_2541);发育与妇儿疾病四川省重点实验室开放课题项目(2023003);国家自然科学基金面上项目(62276118).


A dual-channel feature perception network for medical image segmentation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    卷积神经网络(CNN)在医学图像分析领域得到了广泛应用, 但是受其固定感受野的局限性, 传统的CNN模型难以建立图像中的长距离依赖关系. Transformer通过自注意力机制能够建立图像全局视角下的信息依赖, 拥有更强的序列建模能力. 然而, Transformer难以捕获图像的局部细节特征. 为了解决上述问题, 提出一种基于CNN与Transformer的混合模型DC-TransNet, 用于医学图像分割. 首先, DC-TransNet采用双解码器结构建立图像局部和长距离依赖, 以捕获局部和全局特征; 然后, 考虑到基于编码器-解码器结构的网络模型在不同深度提取到的特征图大小不一致, 设计两种特征感知注意力机制CFP和SFP, 以合理分配局部和全局特征的权重; 最后, 在多个医学数据集上进行实验. 实验结果表明: DC-TransNet在2D医学图像单类别分割任务中取得了有竞争力的结果, mIoU和mDice等系数均得到了显著提升.

    Abstract:

    Convolutional neural networks (CNNs) have been widely used in the field of medical image analysis. However, due to the limitation of its fixed receptive field, the traditional CNN model makes it difficult to establish long-distance dependencies in images. Transformer can establish the information dependence in the global perspective of the image through the self-attention mechanism and has stronger sequence modeling ability. However, Transformer makes it difficult to capture the local detailed features of images. To solve the above problems, a hybrid model DC-TransNet based on the CNN and Transformer is proposed for medical image segmentation. DC-TransNet uses a dual-decoder structure to establish local and long-distance dependencies in the image and capture local and global features. Considering that the size of the feature maps extracted by the network model based on the encoder-decoder structure is inconsistent at different depths, we design two feature perception attention mechanisms, channel feature percep-tion attention (CFP) and spatial feature perception attention (SFP), to reasonably allocate the weight of local and global features. Experiments are conducted on multiple medical datasets and the results show that DC-TransNet is effective in 2D medical images. Competitive results are achieved in single-category segmentation tasks, and coefficients such as mIoU and mDice are significantly improved.

    参考文献
    相似文献
    引证文献
引用本文

武相虎,束鑫,范燕,等.面向医学图像分割的双通道特征感知网络[J].控制与决策,2025,40(3):871-879

复制
相关视频

分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2024-04-02
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2025-02-11
  • 出版日期: 2025-03-20
文章二维码