Cremes: Cost-Efficient and Reliable Microservice Execution on Spot Instances
Liao Chen, Chenyu Lin, Junlin Chen, Shutian Luo, Huanle Xu, ChengZhong Xu
2026Year
Abstract
While spot instances offer a cost-effective alternative to on-demand cloud resources, they introduce reliability challenges for latency-sensitive microservices due to preemption risks and unpredictable provisioning delays. Conventional resource management systems, which often rely on assumptions of immediate instance availability, fail to account for these operational realities—resulting in increased risk of SLO violations when deployed in spot-based environments.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get 39a56889-859c-456a-8cb8-b6ed5e6d15afRelated papers
- SpotServe: Serving Generative Large Language Models on Preemptible InstancesXupeng Miao, Chunan Shi, Jiangfei Duan, Xiaoli Xi et al.ASPLOS 2024 · 71 citations
- Can't Be Late: Optimizing Spot Instance Savings under DeadlinesZhanghao Wu, Wei-Lin Chiang, Ziming Mao, Zongheng Yang et al.NSDI 2024 · 40 citations
- SpotCC: Facilitating Coded Computation for Prediction Serving Systems on Spot InstancesLin Wang, Yuchong Hu, Ziling Duan, Mingqi Li et al.HPCA 2026
- SkyServe: Serving AI Models across Regions and Clouds with Spot InstancesZiming Mao, Tian Xia, Zhanghao Wu, Wei-Lin Chiang et al.EuroSys 2025 · 16 citations
- PERT-GNN: Latency Prediction for Microservice-based Cloud-Native Applications via Graph Neural NetworksDa Sun Handason Tam, Yang Liu, Huanle Xu, Siyue Xie et al.KDD 2023 · 20 citations
