###
计算机系统应用英文版:2021,30(5):150-156
本文二维码信息
码上扫一扫!
融合边缘检测和自注意力的图像修复方法
(西安工程大学 计算机科学学院, 西安 710600)
Combining Edge Detection and Self-Attention for Image Inpainting
(School of Computer Science, Xi'an Polytechnic University, Xi'an 710600, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 735次   下载 1725
Received:August 31, 2020    Revised:September 23, 2020
中文摘要: 针对修复后图像边界模糊、图像纹理不清晰、视觉效果差的问题, 提出了一种融合边缘检测和自注意力机制的生成式对抗修复模型. 通过边缘检测可提取出图像的轮廓信息, 避免了修复后边界模糊的问题; 利用自注意力机制能够捕获图像全局信息并生成图像精确细节的能力, 设计出融合自注意力机制的纹理修复网络. 该模型由边缘补全网络和纹理修复网络组成, 首先, 设计的边缘补全网络对受损图像的边缘进行补全, 得到边缘补全图像; 其次, 利用纹理修复网络联合补全的边缘图像对缺失区域的纹理进行 精确修复. 在CelebA和Place2两个图像数据集上对本文所建模型进行了训练和测试. 实验结果表明: 本文所建模型与现有图像修复方法相比, 大幅提高了图像修复的精确度, 且生成的图像更加逼真.
Abstract:To address the problems of blurred image boundaries, unclear image texture, and poor visual effect after inpainting, we propose a generative adversarial inpainting model that combines edge detection with self-attention mechanism in this study. Through this model, the contour information of the images can be extracted by edge detection, avoiding the problem of blurred boundaries after inpainting. Since the self-attention mechanism can capture the global information of images and generate precise details, a texture inpainting network incorporating the self-attention mechanism is designed. The proposed model is composed of an edge complement network and a texture inpainting network. First, the designed edge complement network completes the edges of a damaged image to obtain an edge complement image. Secondly, the texture of the missing region is accurately inpainted by the texture inpainting network combining the complemented edge image. Finally, the model proposed in this study is trained and tested on the CelebA and Place2 image datasets. The experimental results show that compared with the existing image inpainting methods, the model can greatly improve the accuracy of image inpainting and generate vivid images.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
李维乾,张晓文.融合边缘检测和自注意力的图像修复方法.计算机系统应用,2021,30(5):150-156
LI Wei-Qian,ZHANG Xiao-Wen.Combining Edge Detection and Self-Attention for Image Inpainting.COMPUTER SYSTEMS APPLICATIONS,2021,30(5):150-156