MTTM: Dynamic Fast Memory Partitioning with Bandwidth Optimization for Multi-tenant Cloud

Memory tiering, which extends local DRAM by incorporating remote DRAM or NVM via Compute Express Link (CXL), offers a promising solution to the DRAM capacity scaling problem. However, in multi-tenant cloud environments, efficient management of fast memory requires not only optimizing data movement across tiers but also effectively distributing DRAM capacity when tenants compete. Moreover, bandwidth utilization is critically impacted by memory request rejection, which depends on the distribution of local DRAM. While previous research has extensively addressed data movement, DRAM distribution among multiple tenants remains underexplored.