###
计算机系统应用英文版:2025,34(11):115-126
←前一篇   |   后一篇→
本文二维码信息
码上扫一扫!
基于RL和AIDM的终端区交通流稳定性增强策略
(1.南京航空航天大学 民航学院, 南京 211106;2.清华大学 车辆与运载学院, 北京 100084)
Strategy for Enhancing Traffic Flow Stability in Terminal Areas Based on Reinforcement Learning and Aircraft Intelligent Driving Model
(1.College of Civil Aviation, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China;2.School of Vehicle and Mobility, Tsinghua University, Beijing 100084, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 352次   下载 1349
Received:April 08, 2025    Revised:May 07, 2025
中文摘要: 随着航空业快速发展, 空中交通流量不断攀升, 空域密度显著增大, 飞行间隔标准降低, 使得高密度交通流中跟驰行为愈发显著, 空中交通跟驰建模成为空管领域研究热点. 在现有的空中交通跟驰模型中, 少见考虑前机加速度这一因素, 也缺乏将跟驰稳定判据条件融入强化学习驱动的航空器运行仿真中. 针对以上问题, 本文聚焦飞机呈现高密度运行的终端区进近阶段, 基于地面跟驰理论, 通过考虑地空通信时延, 前机加速度因素构建航空器智能驾驶模型(aircraft intelligent driving model, AIDM), 并通过微扰法以及直接传递函数法进行稳定性分析, 推导出临界稳定条件, 探究模型在前后机之间的局部稳定性及在机队中的渐进稳定性. 最后开展局部稳定性仿真, 渐进稳定性仿真以及终端区航空器跟驰场景仿真, 并将临界稳定性判据条件融入奖励函数与经典强化学习算法结合, 探索航空器自主运行机制并增强运行稳定性. 仿真结果表明, 航空器智能驾驶模型的局部稳定域和渐进稳定域范围都显著增大, 通过对不稳定域面积的分析得出: 对前机加速度的敏感系数从0增加到0.3时, 模型稳定域较原始IDM模型增加8.5%, 减少20 s的通信时延可使稳定域增加17.65%; 通过运行场景仿真分析, 在相同扰动条件下, 航空器智能驾驶模型所需恢复稳定时间比原始IDM模型缩短了21.9%, 而引入稳定性奖励机制的强化学习算法平均分数显著高于传统奖励机制, 有效提高了航空器运行稳定性, 证实该机制在智能体学习过程中的有效性及对航空器自主运行的潜在价值.
Abstract:With the rapid development of the aviation industry, air traffic volume continues to rise, airspace density has increased significantly, and flight separation standards have been reduced, making aircraft-following behavior increasingly prominent in high-density traffic flows. Aircraft-following modeling has become a research hotspot in the field of air traffic control. In existing models, the acceleration of the leading aircraft is rarely considered, and there is a lack of integration of stability criteria into reinforcement learning-driven aircraft operation simulations. To address these issues, this study focuses on the terminal approach phase, where aircraft operate at high density. Based on the ground vehicle-following theory, an aircraft intelligent driving model (AIDM) is developed by considering both ground-to-air communication delays and the acceleration of the leading aircraft. Stability is analyzed by the perturbation method and the direct transfer function method, and the critical stability condition is derived. The model’s local stability (between a leading and a following aircraft) and asymptotic stability (within a fleet) are examined. Finally, local stability simulations, asymptotic stability simulations, and terminal-area aircraft-following scenario simulations are conducted. The derived critical stability criterion is embedded into the reward function and combined with a classical reinforcement learning algorithm to explore autonomous aircraft operation and enhance operational stability. Simulation results show that both the local and asymptotic stability domains of the AIDM are significantly expanded. Analysis of the unstable domain shows that increasing the sensitivity coefficient to the leading aircraft’s acceleration from 0 to 0.3 increases the stability domain of the model by 8.5% compared to the original IDM model. Moreover, reducing the communication delay by 20 s increases the stability domain by 17.65%. In scenario simulations, under identical disturbances, the AIDM requires 21.9% less time to regain stability than the original IDM model. The reinforcement learning algorithm incorporating the stability-aware reward mechanism achieves significantly higher average scores than traditional reward schemes, effectively improving aircraft operational stability. These findings confirm the mechanism’s effectiveness in agent learning and its potential for supporting autonomous aircraft operations.
文章编号:     中图分类号:    文献标志码:
基金项目:中国博士后科学基金面上项目(2024M752347); 江苏省青年基金(BK20230892); 南京航空航天大学校创新计划(xcxjh20240732)
引用文本:
张婷婷,李江晨,朱佳丽,杜梦涵,卢祥.基于RL和AIDM的终端区交通流稳定性增强策略.计算机系统应用,2025,34(11):115-126
ZHANG Ting-Ting,LI Jiang-Chen,ZHU Jia-Li,DU Meng-Han,LU Xiang.Strategy for Enhancing Traffic Flow Stability in Terminal Areas Based on Reinforcement Learning and Aircraft Intelligent Driving Model.COMPUTER SYSTEMS APPLICATIONS,2025,34(11):115-126