###
计算机系统应用英文版:2025,34(7):228-235
本文二维码信息
码上扫一扫!
基于深度语义引导和注意力融合的实时语义分割
赵吴涯1,2,3, 李顺新1,2,3
(1.武汉科技大学 计算机科学与技术学院, 武汉 430065;2.武汉科技大学 大数据科学与工程研究院, 武汉 430065;3.智能信息处理与实时工业系统湖北省重点实验室, 武汉 430081)
Real-time Semantic Segmentation Based on Deep Semantic Guidance and Attention Fusion
ZHAO Wu-Ya1,2,3, LI Shun-Xin1,2,3
(1.School of Computer Science and Technology, Wuhan University of Science and Technology, Wuhan 430065, China;2.Big Data Science and Engineering Research Institute, Wuhan University of Science and Technology, Wuhan 430065, China;3.Hubei Province Key Laboratory of Intelligent Information Processing and Real-time Industrial System, Wuhan 430081, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 412次   下载 835
Received:November 12, 2024    Revised:December 07, 2024
中文摘要: 针对现阶段实时语义分割方法模型冗余度高, 计算成本高和准确率低的问题, 本文提出了一种基于深度语义引导和注意力融合的实时语义分割方法. 采用MobileNetV3作为主干网络, 并在此基础上引入深度双分支并行操作, 使用语义分支指导修正空间分支中的像素点, 在不额外增加参数量的情况下增强了空间分支的细节特征. 此外, 引入注意力融合模块, 使用多尺度分支并行的子结构实现即时响应计算, 并提供一种跨空间信息聚合的方法以提高分割精度. 该方法在Cityscapes和CamVid数据集上以81.2 f/s和147.6 f/s的推理速度分别达到了75.2%和77.4%的MIoU, 同时参数量仅为3.4M. 实验结果表明, 本文方法在保持较少网络参数量的同时, 更好地权衡了语义分割的精度与速度.
Abstract:To address the issues of high redundancy, high computational cost, and low accuracy in current real-time semantic segmentation methods, this study proposes a novel real-time semantic segmentation approach based on deep semantic guidance and attention fusion. The proposed architecture employs MobileNetV3 as its backbone network, enhanced with an innovative deep dual-branch parallel structure. The semantic branch guides the correction of pixel points in the spatial branch, enhancing its detail features without increasing the parameter count. Additionally, an attention fusion module with multi-scale parallel branches is employed to achieve real-time computation and to improve segmentation accuracy through cross-spatial information aggregation. The method achieves inference speeds of 81.2 f/s and 147.6 f/s on the Cityscapes and CamVid datasets, respectively, with MIoU scores of 75.2% and 77.4%, and a parameter count of just 3.4M. Experimental results demonstrate that the proposed method effectively balances segmentation accuracy and speed while maintaining a small parameter count.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金联合基金 (U1803262)
引用文本:
赵吴涯,李顺新.基于深度语义引导和注意力融合的实时语义分割.计算机系统应用,2025,34(7):228-235
ZHAO Wu-Ya,LI Shun-Xin.Real-time Semantic Segmentation Based on Deep Semantic Guidance and Attention Fusion.COMPUTER SYSTEMS APPLICATIONS,2025,34(7):228-235