融合残差增强与动态拓扑的多智能体学习通信框架
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金青年项目(61602254)


Learning Communication Framework for Multi-agent with Residual Enhancment and Dynamic Topology
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    多智能体强化学习(multi-agent reinforcement learning, MARL)在群体智能建模、复杂协作与对抗决策等领域具有广泛应用前景. 然而, 现有基于图神经网络(graph neural network, GNN)的结构化通信方法在深层传播中易出现过平滑, 同时通信拓扑在训练过程中难以自适应更新, 导致通信效率与泛化性能受限. 为解决上述问题, 本文在经典的分层通信架构LSC (learning structured communication)基础上, 提出了一种融合结构残差增强与动态拓扑学习的统一通信框架RESC-LSC. 框架包含两个核心组成: DRGL模块通过可微语义相似度建模实现通信图的自适应重构; REGC模块基于GCNII结构, 引入初始残差注入和恒等映射机制, 以增强深层特征传播的稳定性并缓解过平滑现象. 二者在结构学习与特征传播两个层面协同作用, 从而提升通信图的表达能力与任务适应性. 实验结果表明, RESC-LSC框架在平均回报、通信利用率与结构稳定性等关键指标上, 相较于原始LSC以及其两种消融变体均取得稳定且一致的性能提升, 表明了该方法在复杂多智能体通信建模中的有效性与可扩展性.

    Abstract:

    Multi-agent reinforcement learning (MARL) holds broad application prospects in fields such as collective intelligence modeling, complex collaboration, and adversarial decision-making. However, existing structured communication methods based on graph neural network (GNN) are prone to over-smoothing in deep propagation and the communication topology is difficult to update adaptively during training, which limits communication efficiency and generalization performance. To this end, this study proposes RESC-LSC, a unified communication framework integrating residual-enhancement and dynamic topology learning based on the classic layered communication architecture LSC (learning structured communication). This framework consists of two key components: the DRGL module adaptively reconstructs the communication graph via differentiable semantic similarity modeling, and the REGC module incorporates initial residual injection and identity mapping mechanisms based on the GCNII structure to enhance the stability of deep feature propagation and mitigate over-smoothing. The two modules act synergistically at the two levels of structural learning and feature propagation, thus improving the expressiveness and task adaptability of the communication graph. Experimental results demonstrate that compared with the original LSC and its two ablated variants, the RESC-LSC framework achieves stable and consistent performance improvements in key indicators including average reward, communication efficiency, and structural stability, indicating the effectiveness and scalability of the proposed method for complex multi-agent communication modeling.

    参考文献
    相似文献
    引证文献
引用本文

滕雷雨,孔燕.融合残差增强与动态拓扑的多智能体学习通信框架.计算机系统应用,2026,35(6):14-25

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2025-10-31
  • 最后修改日期:2025-11-20
  • 录用日期:
  • 在线发布日期: 2026-04-30
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62661041 传真: Email:csa@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号