强化学习驱动的高效分层内存管理
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

基金项目:

国家自然科学基金(62172388); 北京市自然科学基金(L251082)


Reinforcement-learning-driven Efficient Tiered Memory Management
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    随着内存密集型应用对内存容量需求的持续增长, 通过引入容量更大、成本更低的慢速内存层, 构建分层内存架构已成为降低数据中心硬件成本的重要途径. 然而, 慢速内存在访问延迟与带宽方面存在明显劣势, 内存管理策略对系统整体性能具有关键影响. 内存密集型应用在运行过程中呈现出显著的动态访存特征, 现有分层内存管理方案多采用静态迁移策略, 难以适应访问模式的阶段性变化, 易引发无效或过度的页面迁移, 从而抵消分层内存带来的潜在性能收益. 针对上述问题, 本文提出一种融合访问频率与访问新近性的热页识别机制, 以更准确地刻画页面的综合访问价值. 并设计了一种基于强化学习的分层内存动态管理方法, 通过运行时策略学习自适应调节跨层页面迁移强度. 本文在真实的DRAM-PMEM分层内存平台上实现并评估了所提方法, 实验结果表明, 该方法在显著减少无效页面迁移开销的同时, 在多种典型内存密集型工作负载下均优于现有分层内存管理方案.

    Abstract:

    As the memory capacity demands of memory-intensive applications continue to grow, tiered memory architectures that incorporate larger-capacity, lower-cost slow memory layers have become an important approach for reducing data center hardware costs. However, due to the significantly higher access latency and lower bandwidth of slow memory, memory management policies play a critical role in overall system performance. During execution, memory-intensive applications exhibit highly dynamic memory access behavior, while most existing tiered memory management schemes rely on static migration policies that are difficult to adapt to phase-varying access patterns. Such static strategies often lead to ineffective or excessive page migrations, thus offsetting the potential performance benefits of tiered memory architectures. To address these challenges, this study proposes a hot-page identification mechanism that integrates access frequency and access recency to more accurately characterize the comprehensive access value of memory pages. Building upon this mechanism, the study further designs a reinforcement learning-based dynamic tiered memory management method, which adaptively regulates cross-tier page migration intensity through policy learning at runtime. The proposed method is implemented and evaluated on a real DRAM-PMEM tiered memory platform. Experimental results demonstrate that the proposed method significantly reduces ineffective page migration overhead while consistently outperforming existing tiered memory management solutions across a variety of representative memory-intensive workloads.

    参考文献
    相似文献
    引证文献
引用本文

李乐,杜翰霖,王卅.强化学习驱动的高效分层内存管理.计算机系统应用,,():1-12

复制
分享
相关视频

文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2026-01-23
  • 最后修改日期:2026-02-14
  • 录用日期:
  • 在线发布日期: 2026-07-03
  • 出版日期:
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62661041 传真: Email:csa@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号