You Can Always Get What You Want: CPU Virtualization Made Fast and Free
Yun Wang, Xingguo Jia, Ben Luo, Kenan Liu, Shengdong Dai, Jingdong Han, Weihao Chen, Xingzi Yu, Chenggang Wu, Yibin Shen, Jiesheng Wu, Tao Song
Abstract
Dedicated VMs provide near bare-metal performance through CPU pinning, interrupt passthrough, and idle passthrough. In conventional deployments, however, these optimizations lock physical cores to individual VMs and prevent CPU sharing. In one of the world's largest cloud platforms, 74% of Dedicated VMs average below 10% CPU utilization, yet they occupy 95% of the physical infrastructure. This paper describes more than three years of deployment experience with Dynamic-Dedicated VMs (DDVMs) to safely reclaim this spare capacity. DDVMs combine workload-signature profiling, mediated posted interrupts, and occupancy-aware idle reclamation to dynamically share CPU cores while preserving Dedicated-VM-level SLOs. The challenge lies not in any single mechanism, but in making conservative, production-safe sharing decisions: identifying when sharing is safe, bounding interrupt latency when vCPUs are preempted, and recovering quickly when conditions change. Deployed across 37 regions and 92,000 servers, DDVMs improve CPU utilization by 10.5% at a 1.1× oversubscription ratio, while keeping SLO scores within the 20% latency-tolerance threshold and the mature-deployment performance-related ticket rate at 0.00035%.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 8b7738f6-780b-46a5-91f3-2b3611a1e983Related papers
- UFO: The Ultimate QoS-Aware Core Management for Virtualized and Oversubscribed Public CloudsYajuan Peng, Shuang Chen, Yi Zhao, Zhibin YuNSDI 2024 · 7 citations
- SmartHarvest: harvesting idle CPUs safely and efficiently in the cloudYawen Wang, Kapil Arya, Marios Kogias, Manohar Vanga et al.EuroSys 2021 · 53 citations
- Optimizing Task Scheduling in Cloud VMs with Accurate vCPU AbstractionEdward Guo, Weiwei Jia, Xiaoning Ding, Jianchen ShanEuroSys 2025 · 3 citations
- HardHarvest: Hardware-Supported Core Harvesting for MicroservicesJovan Stojkovic, Chunao Liu, Muhammad Shahbaz, Josep TorrellasISCA 2025 · 4 citations
- CoINT2: A Heuristic Coordinator for Responsive Receive-Side Network I/O Virtualization in Overcommitment CloudXu Huan, Jian Li, Haibing GuanINFOCOM 2025 · 1 citation
