跨模态融合的双注意力脑肿瘤分割算法
CSTR:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

山西省自然科学基金(20210302123019)


Brain Tumor Segmentation Algorithm Based on Cross-modal Fusion Dual Attention
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对脑肿瘤多模态信息融合不充分以及肿瘤区域细节信息丢失等问题, 提出了一种跨模态融合的双注意力脑肿瘤图像分割网络(CFDA-Net). 在编码器-解码器的基础结构上, 首先在编码器分支采用密集块与大内核注意力并行的新卷积块, 可以使全局和局部信息有效融合且可以防止反向传播时梯度消失的问题; 其次在编码器的第2、3和4层的左侧加入多模态深度融合模块, 有效地利用不同模态间的互补信息; 然后在解码器分支使用Shuffle Attention注意力将特征图分组处理后再聚合, 其中分组的子特征一分为二地获取空间与通道的重要注意特征. 最后使用二进制交叉熵(binary cross entropy, BCE)、Dice Loss与L2 Loss组成新的混合损失函数, 缓解了脑肿瘤数据的类别不平衡问题, 进一步提升分割性能. 在BraTS2019脑肿瘤数据集上的实验结果表明, 该模型在整体肿瘤区域、肿瘤核心区域和肿瘤增强区域的平均Dice系数值分别为0.887、0.892和0.815. 与其他先进的分割方法ADHDC-Net、SDS-MSA-Net等相比, 该模型在肿瘤核心区域和增强区域具有更好的分割效果.

    Abstract:

    This study proposes a cross-modal fusion dual attention net (CFDA-Net) for brain tumor image segmentation to solve the insufficient multi-modal information fusion of brain tumors and detail loss of the tumor regions. Based on the encoder-decoder architecture, a new convolutional block with dense blocks and large kernel attention parallel is first adopted in the encoder branch, which can effectively fuse global and local information and prevent the gradient vanishing during backpropagation. Secondly, a multi-modal deep fusion module is added to the left sides of the second, third, and fourth layers of the encoder to effectively utilize the complementary information among different modalities. Then, in the decoder branch, Shuffle Attention is adopted to group the feature maps and aggregate them, and the subfeatures of the group are divided into two parts to obtain important attention features of space and channels. Finally, binary cross entropy (BCE), Dice Loss, and L2 Loss are employed to form a new hybrid loss function, which alleviates the category imbalance of brain tumor data and further improves the segmentation performance. The experimental results on the BraTS2019 brain tumor dataset show that the average Dice coefficient values of the model in the whole tumor region, tumor core region, and tumor enhancement region are 0.887, 0.892, and 0.815 respectively. The proposed model has better segmentation performance in the core and enhanced regions of tumors than other advanced segmentation methods such as ADHDC-Net and SDS-MSA-Net.

    参考文献
    相似文献
    引证文献
引用本文

张鹏跃,马巧梅.跨模态融合的双注意力脑肿瘤分割算法.计算机系统应用,2024,33(1):119-126

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2023-07-13
  • 最后修改日期:2023-08-11
  • 录用日期:
  • 在线发布日期: 2023-11-24
  • 出版日期: 2023-01-05
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京海淀区中关村南四街4号 中科院软件园区 7号楼305房间,邮政编码:100190
电话:010-62661041 传真: Email:csa (a) iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号