###
计算机系统应用英文版:,():1-12
本文二维码信息
码上扫一扫!
强化学习驱动的高效分层内存管理
(1.南京信息工程大学 计算机学院, 南京 210044;2.中国科学院大学南京学院, 南京 211135;3.中国科学院 计算技术研究所 先进计算机系统研究中心, 北京 100190)
Reinforcement-learning-driven Efficient Tiered Memory Management
(1.School of Computer Science, Nanjing University of Information Science & Technology, Nanjing 210044, China;2.University of Chinese Academy Sciences, Nanjing, Nanjing 211135, China;3.Center for Advanced Computer Systems, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China)
摘要
图/表
参考文献
相似文献
本文已被:浏览 21次   下载 47
Received:January 23, 2026    Revised:February 14, 2026
中文摘要: 随着内存密集型应用对内存容量需求的持续增长, 通过引入容量更大、成本更低的慢速内存层, 构建分层内存架构已成为降低数据中心硬件成本的重要途径. 然而, 慢速内存在访问延迟与带宽方面存在明显劣势, 内存管理策略对系统整体性能具有关键影响. 内存密集型应用在运行过程中呈现出显著的动态访存特征, 现有分层内存管理方案多采用静态迁移策略, 难以适应访问模式的阶段性变化, 易引发无效或过度的页面迁移, 从而抵消分层内存带来的潜在性能收益. 针对上述问题, 本文提出一种融合访问频率与访问新近性的热页识别机制, 以更准确地刻画页面的综合访问价值. 并设计了一种基于强化学习的分层内存动态管理方法, 通过运行时策略学习自适应调节跨层页面迁移强度. 本文在真实的DRAM-PMEM分层内存平台上实现并评估了所提方法, 实验结果表明, 该方法在显著减少无效页面迁移开销的同时, 在多种典型内存密集型工作负载下均优于现有分层内存管理方案.
Abstract:As the memory capacity demands of memory-intensive applications continue to grow, tiered memory architectures that incorporate larger-capacity, lower-cost slow memory layers have become an important approach for reducing data center hardware costs. However, due to the significantly higher access latency and lower bandwidth of slow memory, memory management policies play a critical role in overall system performance. During execution, memory-intensive applications exhibit highly dynamic memory access behavior, while most existing tiered memory management schemes rely on static migration policies that are difficult to adapt to phase-varying access patterns. Such static strategies often lead to ineffective or excessive page migrations, thus offsetting the potential performance benefits of tiered memory architectures. To address these challenges, this study proposes a hot-page identification mechanism that integrates access frequency and access recency to more accurately characterize the comprehensive access value of memory pages. Building upon this mechanism, the study further designs a reinforcement learning-based dynamic tiered memory management method, which adaptively regulates cross-tier page migration intensity through policy learning at runtime. The proposed method is implemented and evaluated on a real DRAM-PMEM tiered memory platform. Experimental results demonstrate that the proposed method significantly reduces ineffective page migration overhead while consistently outperforming existing tiered memory management solutions across a variety of representative memory-intensive workloads.
文章编号:     中图分类号:    文献标志码:
基金项目:国家自然科学基金(62172388); 北京市自然科学基金(L251082)
引用文本:
李乐,杜翰霖,王卅.强化学习驱动的高效分层内存管理.计算机系统应用,,():1-12
LI Le,DU Han-Lin,WANG Sa.Reinforcement-learning-driven Efficient Tiered Memory Management.COMPUTER SYSTEMS APPLICATIONS,,():1-12