Collaborative Research: DESC: Type II: Enhancing Data Center Efficiency through Intelligent Tiered Memory Management

Modern data centers rely on large-scale memory systems to support everything from search engines to scientific computing. However, the increasing demand for memory leads to significant resource and energy use, particularly when older hardware is discarded before its useful life ends. This project addresses that challenge by developing MemWise, an intelligent system that efficiently manages memory across a range of hardware types. The project’s novelties are a programmable memory controller that coordinates how data is moved and stored across different generations of memory; a technique for reusing older memory modules alongside newer ones to reduce cost; and new fault-tolerant methods to ensure reliability even as memory components age. The project's broader significance and importance are in demonstrating that thoughtful system design can extend hardware lifespans and reduce waste, without sacrificing performance. MemWise is tested in a range of real-world environments, including public cloud services, private infrastructures, and direct-to-hardware computing setups, highlighting its adaptability and impact across the data center ecosystem. Specifically, the project designs a tiered memory architecture connected via a flexible hardware interface called Compute Express Link (CXL). A programmable controller dynamically moves data among memory types based on usage patterns, age, and reliability. To guide decision-making, the research introduces a new metric that jointly considers system efficiency and application performance. This allows both software developers and system tools to make informed trade-offs in real time. The controller also supports automatic data migration and transparent fault handling across unreliable memory units, which is essential for mixed-hardware environments. By co-designing hardware and software and validating ideas with real prototypes, the project advances the state of memory system research and offers practical strategies for improving the long-term efficiency of computing infrastructure. Expected impacts include lower operational costs, reduced waste, and broader educational opportunities for students involved in the research. This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.