本文已被:浏览 48次 下载 73次
Received:December 23, 2025 Revised:March 02, 2026
Received:December 23, 2025 Revised:March 02, 2026
中文摘要: 随着智能计算与通信技术的飞速发展, 在未知环境中实现智能传感器群的全面协同态势感知已成为可能. 然而, 障碍物遮挡会导致传感器感知效用模型失真, 从而制约群体协同态势感知能力. 为此, 本文提出一种新的基于深度强化学习的多智能体协同决策方法, 称为分布式动态感知深度Q学习算法(decentralized dynamic sensing optimization with deep Q-learning, DDSO-DQL). 该方案通过构建分布式策略网络评估状态动作价值, 设计分层探索机制提升环境探索效率, 引入历史状态回溯策略增强智能决策稳定性; 赋予移动节点自主协同感知与决策能力, 实现动态态势感知及群体全局优化. 实验结果表明, 在未知环境中, 所提算法相较于传统方法将平均态势感知率提升8.7%, 显著增强了网络协同自主性与动态感知质量, 为意图驱动网络的智能感知与自愈提供了关键技术支撑.
Abstract:With rapid advances in intelligent computing and communication technologies, achieving comprehensive collaborative situational awareness for intelligent sensor swarms in unknown environments has become feasible. However, obstacle occlusion can distort sensor perception utility models, thus limiting the swarm’s collaborative situational awareness capability. Therefore, this study proposes a new multi-agent collaborative decision-making method based on deep reinforcement learning, termed decentralized dynamic sensing optimization with deep Q-learning (DDSO-DQL) algorithm. The proposed approach constructs a distributed policy network to evaluate state-action values, designs a hierarchical exploration mechanism to improve environmental exploration efficiency, and incorporates a historical state backtracking strategy to enhance decision-making stability. This framework enables nodes to perform collaborative perception and decision-making autonomously, supporting dynamic situational awareness and global swarm optimization. Experimental results show that, in unknown environments, the proposed algorithm improves the average situational awareness rate by 8.7% compared to traditional methods, significantly enhancing collaborative network autonomy and dynamic sensing quality, and providing key technical support for intelligent perception and self-healing in intent-driven networks.
keywords: multi-agent collaboration situation awareness reinforcement learning (RL) unknown environment
文章编号: 中图分类号: 文献标志码:
基金项目:四川省科技计划(2023YF0301)
引用文本:
赵长名,姚宇坤,赵粒宇.DDSO-DQL: 基于多智能体协同的智能传感器集群态势感知算法.计算机系统应用,2026,35(8):12-23
ZHAO Chang-Ming,YAO Yu-Kun,ZHAO Li-Yu.DDSO-DQL: Situation Awareness Algorithm for Intelligent Sensor Swarms Based on Multi-agent Collaboration.COMPUTER SYSTEMS APPLICATIONS,2026,35(8):12-23
赵长名,姚宇坤,赵粒宇.DDSO-DQL: 基于多智能体协同的智能传感器集群态势感知算法.计算机系统应用,2026,35(8):12-23
ZHAO Chang-Ming,YAO Yu-Kun,ZHAO Li-Yu.DDSO-DQL: Situation Awareness Algorithm for Intelligent Sensor Swarms Based on Multi-agent Collaboration.COMPUTER SYSTEMS APPLICATIONS,2026,35(8):12-23

