本文已被:浏览 61次 下载 85次
Received:November 10, 2025 Revised:December 02, 2025
Received:November 10, 2025 Revised:December 02, 2025
中文摘要: 为了解决多模态方面级情感分析当前方法的局限性: 易受视觉噪声干扰以及对方面表征的过度简化, 提出了视觉去噪与方面增强(visual denoising and aspect-enhanced, VDAE)方法, 该方法整合了图文相关性过滤和语义相关性过滤以实现视觉噪声抑制, 并结合多模态语义增强. VDAE包含两个组件: 多视角方面增强模块(multi-perspective aspect enhancement module, MPAEM)利用跨模态交互增强方面表征, 情感-语义-句法图卷积网络(sentiment-semantic-syntactic graph convolutional network, S3GCN)综合情感线索实现视觉信息的有效利用. 在Twitter2015和Twitter2017基准数据集上测试的实验结果表明, 该方法在多模态方面级情感分析3个子任务上相较于基线方法取得了显著性能提升.
中文关键词: 多模态方面级情感分析 多模态情感分析 多模态语义增强 自然语言处理 情感计算
Abstract:To address the limitations of current multimodal aspect-based sentiment analysis (MABSA) approaches, including susceptibility to visual noise interference and oversimplification of aspect representations, this study proposes a visual denoising and aspect-enhanced (VDAE) method. This method systematically integrates image-text relevance filtering and semantic relevance filtering to achieve visual noise suppression, in combination with multimodal semantic enhancement. VDAE consists of two components: the multi-perspective aspect enhancement module (MPAEM), which enhances aspect representations through cross-modal interactions, and the sentiment-semantic-syntactic graph convolutional network (S3GCN), which enables effective utilization of visual information by jointly modeling sentiment cues. Experimental results on datasets Twitter2015 and Twitter2017 benchmarks indicate that the proposed method achieves significant performance improvements over baseline methods across all three MABSA sub-tasks.
keywords: multimodal aspect-based sentiment analysis (MABSA) multimodal sentiment analysis (MSA) multimodal semantic enhancement natural language processing (NLP) affective computing
文章编号: 中图分类号: 文献标志码:
基金项目:广东省基础与应用基础研究基金 (2022A1515140110)
引用文本:
汪红松,吴威龙,张军华.视觉噪声抑制与方面增强的多模态方面级情感分析.计算机系统应用,2026,35(6):122-132
WANG Hong-Song,WU Wei-Long,ZHANG Jun-Hua.Visual Noise Suppression and Aspect Enhancement for Multimodal Aspect-based Sentiment Analysis.COMPUTER SYSTEMS APPLICATIONS,2026,35(6):122-132
汪红松,吴威龙,张军华.视觉噪声抑制与方面增强的多模态方面级情感分析.计算机系统应用,2026,35(6):122-132
WANG Hong-Song,WU Wei-Long,ZHANG Jun-Hua.Visual Noise Suppression and Aspect Enhancement for Multimodal Aspect-based Sentiment Analysis.COMPUTER SYSTEMS APPLICATIONS,2026,35(6):122-132

