###
计算机系统应用英文版:2026,35(8):319-331
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于领域知识增强CLIP-FastSAM的沥青路面裂缝检测
(1.安徽建工检测科技集团有限公司 信息服务中心, 合肥 230088;2.安徽天筑智检信息技术有限公司 研发部, 合肥 230088;3.合肥工业大学 土木与水利工程学院, 合肥 230009)
Asphalt Pavement Crack Detection Based on Domain Knowledge-enhanced CLIP-FastSAM
(1.Department of Information Services, Anhui Construction Engineering Inspection Technology Group Co. Ltd., Hefei 230088, China;2.Department of Research and Development, Anhui Tianzhu Intelligent Inspection Information Technology Co. Ltd., Hefei 230088, China;3.College of Civil Engineering, Hefei University of Technology, Hefei 230009, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 44次   下载 45
Received:December 24, 2025    Revised:January 19, 2026
中文摘要: 现有的路面裂缝病害检测算法难以充分捕捉细小且不规则裂缝的细节特征, 需进一步提升裂缝检测的精细化程度与工程适用性. 本文提出一种融合裂缝病害领域知识结构化的CLIP与FastSAM图像分割方法. 首先, 构建沥青路面裂缝病害领域知识图, 并设计专门的知识结构化编码器; 随后, 采用两阶段融合策略, 即先利用结构化知识微调CLIP模型以增强其裂缝语义表示能力, 再将知识结构化增强后的CLIP特征嵌入FastSAM中引导裂缝分割检测. 实验结果表明, 知识结构化的CLIP在自建的CBAPDD-30K (custom-built asphalt pavement damage dataset-30K)数据集和公开数据集MSCOCO上均优于现有方法, 显著提升了细粒度语义图像匹配的准确性. 在服务端实验中, 该模型在CBAPDD-30K数据集上的精确率 (91.67%)、召回率 (90.87%)、F1值 (91.27%)及mIoU (81.91%)均优于主流轻量级与多模态模型; 在边缘端部署时, 其在FPS与推理时间上展现出良好的实时性. 该方法实现了检测精度与速度的平衡, 具有较高的工程应用价值.
Abstract:Accurate detection of pavement cracks is essential for traffic safety, yet existing models often struggle to capture the detailed features of fine and irregular cracks, limiting their engineering applicability. This study aims to enhance the precision and practicality of crack detection. A novel image segmentation method is proposed by integrating domain knowledge-structured CLIP with the FastSAM image segmentation model. First, a structural knowledge graph of asphalt pavement crack distress is constructed, and a dedicated knowledge structuring encoder is designed. Subsequently, a two-stage fusion strategy is implemented. The CLIP model is fine-tuned with the structured knowledge to strengthen its semantic representation of cracks. The enhanced CLIP features are then embedded into the FastSAM encoder to guide the segmentation process. Experimental results show that the knowledge structured CLIP outperforms existing methods on both the custom-built CBAPDD-30K and the public MSCOCO datasets, significantly improving the accuracy of fine- grained semantic image matching. On the CBAPDD-30K dataset, the proposed two-stage fusion model achieves superior performance. In server-side experiments, it attains a precision of 91.67%, a recall of 90.87%, an F1-score of 91.27%, and an mIoU of 81.91%, surpassing mainstream lightweight and multi-modal models. When deployed on edge devices, the model exhibits efficient real-time performance in terms of FPS and inference time. This method achieves a favorable balance between detection precision and speed. It possesses high engineering application value.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
孙翔,陈旭阳,钱小东,石玉磊.基于领域知识增强CLIP-FastSAM的沥青路面裂缝检测.计算机系统应用,2026,35(8):319-331
SUN Xiang,CHEN Xu-Yang,QIAN Xiao-Dong,SHI Yu-Lei.Asphalt Pavement Crack Detection Based on Domain Knowledge-enhanced CLIP-FastSAM.COMPUTER SYSTEMS APPLICATIONS,2026,35(8):319-331