基于双分支编码和语义引导的视频人像抠图方法
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

辽宁省“揭榜挂帅”科技攻关项目(2023JH1/10400090)


Video Portrait Matting Method Based on Dual-branch Encoding and Semantic Guidance
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对资源受限场景下视频人像抠图在复杂边界结构与长时间序列中易出现语义漂移、边界模糊和细节退化等问题, 本文提出一种基于双分支编码和语义引导的高效视频人像抠图方法. 在编码阶段构建高低比特双分支结构, 利用低比特分支对大多数视频帧进行快速特征提取, 降低计算复杂度和存储开销, 并通过周期性触发的高比特关键帧分支对语义表示进行刷新, 从而缓解长期二值化建模带来的表达能力不足问题; 在解码阶段, 设计了一种轻量级的关键帧语义引导与区域自适应门控融合模块, 在特征空间中显式建模关键帧语义与上一帧传播信息之间的互补关系, 使模型在主体稳定区域优先保持时间连续性, 在边界与显著变化区域增强细节敏感性与结构一致性. 在多个公开视频抠图基准数据集上的实验结果表明, 所提方法在显著降低平均计算量和内存占用的同时, 有效提升了抠图结果的时间一致性与边界质量, 在结构设计上具备面向移动端和边缘设备等资源受限环境进一步部署优化的潜力.

    Abstract:

    To address semantic drift, boundary blurring, and detail degradation that commonly arise in resource-constrained video portrait matting, especially with complex boundaries and long temporal sequences, this study proposes an efficient method based on dual-branch encoding and semantic guidance. In the encoding stage, a dual-branch structure with high-bit and low-bit branches is constructed. The low-bit branch performs fast feature extraction for the majority of video frames, thus reducing computational complexity and storage overhead. Meanwhile, a high-bit keyframe branch is periodically activated to refresh the semantic representation, alleviating the limited expressive capacity of long-term binarized modeling. In the decoding stage, a lightweight module for keyframe semantic guidance and region-adaptive gated fusion is designed. This module explicitly models the complementary relationship between keyframe semantics and information propagated from the previous frame in the feature space. As a result, the model prioritizes temporal continuity in stable subject regions while enhancing detail sensitivity and structural consistency in boundary regions and regions with significant changes. Experimental results on multiple public video matting benchmark datasets demonstrate that the proposed method significantly reduces average computational cost and memory usage while effectively improving the temporal consistency and boundary quality of the matting results. In terms of structural design, the proposed method has the potential for further deployment optimization in resource-constrained environments such as mobile and edge devices.

    参考文献
    相似文献
    引证文献
引用本文

张德康,张宇鑫,张伟,雷为民,任颋.基于双分支编码和语义引导的视频人像抠图方法.计算机系统应用,,():1-11

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-02-27
  • 最后修改日期:2026-03-27
  • 录用日期:
  • 在线发布日期: 2026-08-21
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62661041 传真: Email:csa@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号