###
计算机系统应用英文版:2025,34(3):161-170
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于DeepLIFT算法的可解释多模态假新闻检测
(1.南京信息工程大学 软件学院, 南京 210044;2.南京信息工程大学 计算机学院, 南京 210044)
Explainable Multimodal Fake News Detection Based on DeepLIFT Algorithm
(1.School of Software, Nanjing University of Information Science & Technology, Nanjing 210044, China;2.School of Computer Science, Nanjing University of Information Science & Technology, Nanjing 210044, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 618次   下载 1754
Received:July 16, 2024    Revised:October 30, 2024
中文摘要: 目前, 大多数多模态可解释假新闻检测方法忽视了对解释数据和跨模态特征的进一步研究利用, 导致可解释假新闻检测方法, 虽然对模型的决策做出了解释, 但是模型检测性能并没有优于先进的多模态检测方法. 针对这些问题, 提出了一种迭代的可解释多模态假新闻检测框架. 该方法由主模型和解释模块构成, 二者都接收多模态新闻作为输入. 首先, 解释模块中将DeepLIFT解释算法计算出的解释数据也作为主模型的输入之一, 参与到主模型的决策过程. 接着, 主模型中通过多任务网络框架计算出跨模态相关特征和跨模态补充特征, 并通过跨模态相关特征的粗预测分数对跨模态补充特征重新加权进行细化, 多种特征拼接起来进行模型决策. 最后, 解释模块利用知识蒸馏从主模型转移决策知识进行训练. 主模型和解释模块交替训练, 整体构成了迭代的框架, 在提供决策解释的同时, 进一步提升模型检测性能. 在两个公开的假新闻检测数据集上进行大量实验, 实验结果证明所提出的方法优于最先进的多模态假新闻检测方法.
Abstract:Currently, most explainable multimodal fake news detection methods overlook the further research and utilization of explanation data and cross-modal features. As a result, while these explainable fake news detection methods provide explanations for model decisions, their detection performance does not surpass that of advanced multimodal detection methods. To address these issues, this study proposes an iterative explainable multimodal fake news detection framework. This method consists of a main model and an explanation module, both of which receive multimodal news as input. First, the explanation module uses the explanation data calculated by the DeepLIFT algorithm as one of the inputs to the main model, contributing to the decision-making process. Next, the main model calculates cross-modal relevant features and cross-modal supplementary features through a multi-task network framework. It refines the cross-modal supplementary features by re-weighting them with the coarse prediction scores from the cross-modal relevant features and combines multiple features to make the final model decision. Finally, the explanation module trains by transferring decision knowledge from the main model by using knowledge distillation. The main model and the explanation module are trained alternately, forming an iterative framework that enhances model detection performance while providing decision explanations. Extensive experiments on two publicly available fake news detection datasets demonstrate that the proposed method outperforms state-of-the-art multimodal fake news detection methods.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(61902193)
引用文本:
王炎,应龙.基于DeepLIFT算法的可解释多模态假新闻检测.计算机系统应用,2025,34(3):161-170
WANG Yan,YING Long.Explainable Multimodal Fake News Detection Based on DeepLIFT Algorithm.COMPUTER SYSTEMS APPLICATIONS,2025,34(3):161-170