###
计算机系统应用英文版:2025,34(7):117-127
本文二维码信息
码上扫一扫!
基于多尺度感知学习的图像篡改检测与定位
(1.南京信息工程大学 计算机学院、网络空间安全学院, 南京 210044;2.南京信息工程大学 数字取证教育部工程研究中心, 南京 210044;3.暨南大学 网络空间安全学院, 广州 510632)
Multi-scale Perceptual Learning for Image Manipulation Detection and Localization
(1.School of Computer Science, School of Cyber Science and Engineering, Nanjing University of Information Science & Technology, Nanjing 210044, China;2.Engineering Research Center of Digital Forensics of Ministry of Education, Nanjing University of Information Science & Technology, Nanjing 210044, China;3.College of Cyber Security, Jinan University, Guangzhou 510632, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 497次   下载 892
Received:December 04, 2024    Revised:December 25, 2024
中文摘要: 为了解决现有图像篡改检测方法在检测定位性能与鲁棒性方面的不足, 本文提出了一种多尺度感知学习网络(MsPL-Net). 首先, 为了扩展感受野并解决图像后处理和操作类型多样导致的鲁棒性弱的难题, 提出了一种分层密集链接多尺度扩展卷积模块(MSDCM). 该模块可放大感受野以捕捉多尺度特征信息, 同时保持输入图像的高分辨率表示, 无缝提取复杂的图像细节和边缘信息. 其次, 为了解决篡改大小敏感性导致的篡改边缘位置模糊问题, 提出了一种由全局注意力、局部注意力和门控特征调节器组成的信息互补感知注意力模块 (ICPAM). 全局注意可以捕捉图像的整体形状、结构或背景信息, 而局部注意可以学习图像的局部区域和具体细节, 两者交互融合, 提高定位精度. 门控特征调节器采用精细嵌入从全局和局部特征图中过滤出不相关的特征和噪声响应, 引导下游识别和学习由不同篡改技术引起的异常纹理、边缘变化和其他特征信息. 最后, 设计一种新的联合损失函数, 进一步提高网络的检测性能和定位准确率. 相较于最新工作, 本文方法的检测准确率提高了2.3%. 此外, 在鲁棒性和泛化性上同样表现出较好的性能, 以及篡改区域定位更精确和清晰.
Abstract:To address the shortcomings of existing image tampering detection methods in terms of detection and localization performance as well as robustness, a multi-scale perceptual learning network (MsPL-Net) is proposed. Firstly, to expand the receptive field and address the issue of weak feature robustness resulting from diverse image post-processing and operation types, a hierarchical dense linked multi-scale dilated convolution module (MSDCM) is introduced. This module expands the receptive field to capture multi-scale feature information while preserving the high-resolution representation of input images, seamlessly extracting intricate image details and edge information. Secondly, to solve the problem of blurred tampered edge positions caused by sensitivity to tampering size, an information complementary perception attention module (ICPAM) is proposed, consisting of global attention, local attention, and a gated feature modulator. The global and local attention mechanisms operate in parallel and complement each other: through feature interaction and fusion, the model’s representational capacity is enhanced, leading to improved localization performance. Global attention captures the overall shape, structure, or background information of the image, while local attention focuses on learning the local regions and specific details of the image. The two mechanisms interact and integrate to enhance positioning accuracy. The gated feature modulator employs fine embeddings to filter out irrelevant features and noise responses from the global and local feature maps. This facilitates downstream recognition and learning of abnormal textures, edge changes, and other feature information caused by different tampering techniques. Finally, a novel joint loss function is designed to further enhance the detection performance and localization accuracy of the network. Compared with the latest works, the detection accuracy of the proposed method is improved by 2.3%. In addition, the proposed method demonstrates excellent performance in terms of robustness and generalization, offering more accurate and clear localization.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(62102189, 62122032); 国家社会科学基金(2022-SKJJ-C-082)
引用文本:
徐悦,袁程胜,刘庆程,夏志华.基于多尺度感知学习的图像篡改检测与定位.计算机系统应用,2025,34(7):117-127
XU Yue,YUAN Cheng-Sheng,LIU Qing-Cheng,XIA Zhi-Hua.Multi-scale Perceptual Learning for Image Manipulation Detection and Localization.COMPUTER SYSTEMS APPLICATIONS,2025,34(7):117-127