###
计算机系统应用英文版:2026,35(6):14-25
本文二维码信息
码上扫一扫!
融合残差增强与动态拓扑的多智能体学习通信框架
(1.南京信息工程大学 计算机学院、网络空间安全学院, 南京 210044;2.南京信息工程大学 软件学院, 南京 210044)
Learning Communication Framework for Multi-agent with Residual Enhancment and Dynamic Topology
(1.School of Computer Science & School of Cyber Science and Engineering, Nanjing University of Information Science & Technology, Nanjing 210044, China;2.School of Software, Nanjing University of Information Science & Technology, Nanjing 210044, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 117次   下载 114
Received:October 31, 2025    Revised:November 20, 2025
中文摘要: 多智能体强化学习(multi-agent reinforcement learning, MARL)在群体智能建模、复杂协作与对抗决策等领域具有广泛应用前景. 然而, 现有基于图神经网络(graph neural network, GNN)的结构化通信方法在深层传播中易出现过平滑, 同时通信拓扑在训练过程中难以自适应更新, 导致通信效率与泛化性能受限. 为解决上述问题, 本文在经典的分层通信架构LSC (learning structured communication)基础上, 提出了一种融合结构残差增强与动态拓扑学习的统一通信框架RESC-LSC. 框架包含两个核心组成: DRGL模块通过可微语义相似度建模实现通信图的自适应重构; REGC模块基于GCNII结构, 引入初始残差注入和恒等映射机制, 以增强深层特征传播的稳定性并缓解过平滑现象. 二者在结构学习与特征传播两个层面协同作用, 从而提升通信图的表达能力与任务适应性. 实验结果表明, RESC-LSC框架在平均回报、通信利用率与结构稳定性等关键指标上, 相较于原始LSC以及其两种消融变体均取得稳定且一致的性能提升, 表明了该方法在复杂多智能体通信建模中的有效性与可扩展性.
Abstract:Multi-agent reinforcement learning (MARL) holds broad application prospects in fields such as collective intelligence modeling, complex collaboration, and adversarial decision-making. However, existing structured communication methods based on graph neural network (GNN) are prone to over-smoothing in deep propagation and the communication topology is difficult to update adaptively during training, which limits communication efficiency and generalization performance. To this end, this study proposes RESC-LSC, a unified communication framework integrating residual-enhancement and dynamic topology learning based on the classic layered communication architecture LSC (learning structured communication). This framework consists of two key components: the DRGL module adaptively reconstructs the communication graph via differentiable semantic similarity modeling, and the REGC module incorporates initial residual injection and identity mapping mechanisms based on the GCNII structure to enhance the stability of deep feature propagation and mitigate over-smoothing. The two modules act synergistically at the two levels of structural learning and feature propagation, thus improving the expressiveness and task adaptability of the communication graph. Experimental results demonstrate that compared with the original LSC and its two ablated variants, the RESC-LSC framework achieves stable and consistent performance improvements in key indicators including average reward, communication efficiency, and structural stability, indicating the effectiveness and scalability of the proposed method for complex multi-agent communication modeling.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金青年项目(61602254)
引用文本:
滕雷雨,孔燕.融合残差增强与动态拓扑的多智能体学习通信框架.计算机系统应用,2026,35(6):14-25
TENG Lei-Yu,KONG Yan.Learning Communication Framework for Multi-agent with Residual Enhancment and Dynamic Topology.COMPUTER SYSTEMS APPLICATIONS,2026,35(6):14-25