本文已被:浏览 44次 下载 45次
Received:December 24, 2025 Revised:January 19, 2026
Received:December 24, 2025 Revised:January 19, 2026
中文摘要: 现有的路面裂缝病害检测算法难以充分捕捉细小且不规则裂缝的细节特征, 需进一步提升裂缝检测的精细化程度与工程适用性. 本文提出一种融合裂缝病害领域知识结构化的CLIP与FastSAM图像分割方法. 首先, 构建沥青路面裂缝病害领域知识图, 并设计专门的知识结构化编码器; 随后, 采用两阶段融合策略, 即先利用结构化知识微调CLIP模型以增强其裂缝语义表示能力, 再将知识结构化增强后的CLIP特征嵌入FastSAM中引导裂缝分割检测. 实验结果表明, 知识结构化的CLIP在自建的CBAPDD-30K (custom-built asphalt pavement damage dataset-30K)数据集和公开数据集MSCOCO上均优于现有方法, 显著提升了细粒度语义图像匹配的准确性. 在服务端实验中, 该模型在CBAPDD-30K数据集上的精确率 (91.67%)、召回率 (90.87%)、F1值 (91.27%)及mIoU (81.91%)均优于主流轻量级与多模态模型; 在边缘端部署时, 其在FPS与推理时间上展现出良好的实时性. 该方法实现了检测精度与速度的平衡, 具有较高的工程应用价值.
Abstract:Accurate detection of pavement cracks is essential for traffic safety, yet existing models often struggle to capture the detailed features of fine and irregular cracks, limiting their engineering applicability. This study aims to enhance the precision and practicality of crack detection. A novel image segmentation method is proposed by integrating domain knowledge-structured CLIP with the FastSAM image segmentation model. First, a structural knowledge graph of asphalt pavement crack distress is constructed, and a dedicated knowledge structuring encoder is designed. Subsequently, a two-stage fusion strategy is implemented. The CLIP model is fine-tuned with the structured knowledge to strengthen its semantic representation of cracks. The enhanced CLIP features are then embedded into the FastSAM encoder to guide the segmentation process. Experimental results show that the knowledge structured CLIP outperforms existing methods on both the custom-built CBAPDD-30K and the public MSCOCO datasets, significantly improving the accuracy of fine- grained semantic image matching. On the CBAPDD-30K dataset, the proposed two-stage fusion model achieves superior performance. In server-side experiments, it attains a precision of 91.67%, a recall of 90.87%, an F1-score of 91.27%, and an mIoU of 81.91%, surpassing mainstream lightweight and multi-modal models. When deployed on edge devices, the model exhibits efficient real-time performance in terms of FPS and inference time. This method achieves a favorable balance between detection precision and speed. It possesses high engineering application value.
文章编号: 中图分类号: 文献标志码:
基金项目:
引用文本:
孙翔,陈旭阳,钱小东,石玉磊.基于领域知识增强CLIP-FastSAM的沥青路面裂缝检测.计算机系统应用,2026,35(8):319-331
SUN Xiang,CHEN Xu-Yang,QIAN Xiao-Dong,SHI Yu-Lei.Asphalt Pavement Crack Detection Based on Domain Knowledge-enhanced CLIP-FastSAM.COMPUTER SYSTEMS APPLICATIONS,2026,35(8):319-331
孙翔,陈旭阳,钱小东,石玉磊.基于领域知识增强CLIP-FastSAM的沥青路面裂缝检测.计算机系统应用,2026,35(8):319-331
SUN Xiang,CHEN Xu-Yang,QIAN Xiao-Dong,SHI Yu-Lei.Asphalt Pavement Crack Detection Based on Domain Knowledge-enhanced CLIP-FastSAM.COMPUTER SYSTEMS APPLICATIONS,2026,35(8):319-331

