基于无源通用领域自适应的开放世界多模态社会事件检测
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(61902193)


Open-world Multimodal Social Event Detection Based on Source-free Universal Domain Adaptation
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着互联网的快速发展和社交媒体使用的普及, 各类社交媒体平台每天都会产生大量的多模态数据, 如何从中高效、准确地检测和识别社会事件已成为舆情分析与社会治理中的关键问题. 传统方法依赖固定类别和充足标注数据, 难以适应真实场景: 第一, 社交媒体数据具有显著的时序动态性, 不同时间段的数据在分布与语义上差异显著; 第二, 新的事件类型不断出现, 当前时间段的数据中同时包含已知类别与未知类别, 且其类别数量往往无法预先确定; 第三, 在实际应用中往往难以获取或重新访问历史时间段的源域数据, 使得模型需要在无源的条件下面向目标时间段进行自适应更新. 针对这些问题, 本文提出了一个基于无源通用领域自适应的开放世界多模态社会事件检测方法. 该方法以先前时间段训练得到的模型作为知识基础, 在当前时间段的数据上, 基于先验分类器权重对多模态特征空间进行子空间分解, 将特征表示划分为已知语义相关子空间与潜在未知语义子空间, 并在对应子空间中生成合成样本用于训练目标分类器. 在目标时间段内联合优化特征提取器与分类器, 通过结合非平衡最优传输与分类器预测分布, 构建样本级的置信一致性筛选机制, 对高置信样本用于伪标签监督以增强已知类别的判别能力, 低置信样本通过结构一致性约束引导其在特征空间中形成稳定的结构. 随着特征结构的逐步优化, 分类器判别能力与样本置信评估的可靠性进一步提升, 从而形成由判别能力、置信筛选与结构优化相互促进的良性闭环. 实验结果表明, 本文的方法在两个公开数据集上优于所有对比方法, 验证了本方法的有效性.

    Abstract:

    With the rapid development of the Internet and widespread use of social media, massive amounts of multimodal data are generated daily on various platforms. Effectively and accurately detecting and identifying social events from such data has become a critical challenge in public opinion analysis and social governance. Traditional methods rely on fixed category sets and abundant labeled data, making them difficult to adapt to real-world scenarios. First, social media data exhibit pronounced temporal dynamics, with significant differences in distribution and semantics across different time periods. Second, new event types continuously emerge, meaning that data in the current time period include both known and unknown categories, and the total number of categories is often unknown in advance. Third, in practical applications, it is often difficult to obtain or revisit source-domain data from historical time periods, which requires the model to adapt to the target time period under source-free conditions. To address these challenges, this study proposes an open-world multimodal social event detection method based on source-free universal domain adaptation. The proposed method leverages a model trained on a previous time period as prior knowledge and performs subspace decomposition of the multimodal feature space on data from the current time period, based on prior classifier weights. The feature representations are separated into subspaces associated with known semantics and potential unknown semantics, within which synthetic samples are generated for training the target classifier. During the target time period, the feature extractor and classifier are jointly optimized. By integrating unbalanced optimal transport with classifier prediction distributions, a sample-level confidence consistency filtering mechanism is constructed. High-confidence samples are used for pseudo-label supervision to enhance the discriminative ability of known categories, while low-confidence samples are guided by structural consistency constraints to form stable structures in the feature space. As the feature structures are progressively optimized, both the discriminative ability of the classifier and the reliability of sample confidence estimation are further improved, thus forming a positive feedback loop in which discriminative ability, confidence filtering, and structural optimization mutually reinforce each other. Experimental results on two public datasets demonstrate that the proposed method outperforms the baseline methods, validating its effectiveness.

    参考文献
    相似文献
    引证文献
引用本文

孟依然,应龙.基于无源通用领域自适应的开放世界多模态社会事件检测.计算机系统应用,,():1-13

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-01-07
  • 最后修改日期:2026-02-02
  • 录用日期:
  • 在线发布日期: 2026-07-14
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62661041 传真: Email:csa@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号