###
计算机系统应用英文版:2026,35(7):130-139
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
层级语义与跨模态融合的海洋生物分类
(青岛科技大学 信息科学技术学院, 青岛 266061)
Hierarchical Semantics and Cross-modal Fusion for Marine Organism Classification
(School of Information Science and Technology, Qingdao University of Science & Technology, Qingdao 266061, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 46次   下载 76
Received:December 23, 2025    Revised:January 12, 2026
中文摘要: 针对复杂水下环境中海洋生物细粒度分类易受类别相似性高、背景干扰强及语义歧义大的问题, 本文提出一种融合层级语义建模与跨模态特征调制的海洋生物分类方法. 首先, 构建层级类别预划分与判别路由模块, 将细粒度类别空间重构为语义一致的大类层级, 并结合CLIP语义判别与GFNet结构判别实现高置信度专家路由. 其次, 设计上下文属性语义推理模块, 将符号化上下文属性转化为可被CLIP利用的文本描述, 并通过条件概率建模获得稳定的语义先验. 进一步提出“结构-语义”一致性裁决机制, 降低错误路由风险. 在特征融合层面, 引入文本调制融合控制模块与语义门控残差融合机制, 将全局语义信息自适应注入高层及多尺度视觉特征中. 实验结果表明, 该方法在复杂海洋生物分类任务中有效提升了分类稳定性与鲁棒性.
Abstract:For fine-grained marine organism classification in complex underwater environments, challenges such as high class similarity, strong background interference, and significant semantic ambiguity persist. To address these challenges, this study proposes a marine organism classification method that integrates hierarchical semantic modeling and cross-modal feature modulation. First, a hierarchical class pre-segmentation and discriminative routing module is constructed to reconstruct the fine-grained class space into a semantically consistent hierarchical class structure. High-confidence expert routing is achieved by combining CLIP semantic discrimination and GFNet structural discrimination. Second, a contextual attribute semantic reasoning module is designed to transform symbolic contextual attributes into textual descriptions that can be employed by CLIP, and stable semantic priors are obtained through conditional probability modeling. A structure-semantic consistency adjudication mechanism is further proposed to reduce the risk of routing errors. At the feature fusion level, a text modulation fusion control module and a semantic gating residual fusion mechanism are introduced to adaptively inject global semantic information into high-level and multi-scale visual features. Experimental results show that this method effectively improves classification stability and robustness in complex marine organism classification tasks.
文章编号:     中图分类号:    文献标志码:
基金项目:
引用文本:
童博,程远志.层级语义与跨模态融合的海洋生物分类.计算机系统应用,2026,35(7):130-139
TONG Bo,CHENG Yuan-Zhi.Hierarchical Semantics and Cross-modal Fusion for Marine Organism Classification.COMPUTER SYSTEMS APPLICATIONS,2026,35(7):130-139