Making Serverless Pay-For-Use a Reality with Leopard
Tingjia Cao, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Tyler Caraza-Harter
Abstract
Serverless computing has gained traction due to its eventdriven architecture and "pay for use" (PFU) billing model. However, our analysis reveals that current billing practices do not align with true resource consumption. This paper challenges the prevailing SLIM (static, linear, interactive-only model) assumptions that underpin existing billing models, demonstrating that current billing does not realize PFU for realistic workloads. We introduce the Nearly Pay-for-Use (NPFU) billing model, which accommodates varying CPU and memory demands, spot cores, and preemptible memory. We also introduce Leopard, an NPFU-based serverless platform that integrates billing awareness into several major subsystems: CPU scheduler, OOM killer, admission controller, and cluster scheduler. Experimental results indicate that Leopard benefits both providers and users, increasing throughput by more than 2x and enabling cost reductions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 84901a38-5ea0-4ab1-9462-87c927bfdf36Cited by top-tier papers3
- Demystifying Serverless Costs on Public Platforms: Bridging Billing, Architecture, and OS SchedulingChangyuan Lin, Yuanzhi Ma, Mohammad ShahradEuroSys 2026 · 3 citations
- kSTEP: Characterization and Deterministic Testing of Linux CPU Scheduler BugsTingjia Cao, Shawn (Wanxiang) Zhong, Caeden Whitaker, Ke Han et al.OSDI 2026 · 1 citation
- Skyler: Static Analysis for Predicting API-Driven Costs in Serverless ApplicationsBernardo Ribeiro, Mafalda Ferreira, José Fragoso Santos, Rodrigo Bruno et al.ASPLOS 2026
Builds on22
- Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud ProviderMohammad Shahrad, Rodrigo Fonseca, Iñigo Goiri, Gohar Irfan Chaudhry et al.USENIX ATC 2020 · 946 citations
- FaasCache: keeping serverless computing alive with greedy-dual cachingAlexander Fuerst, Prateek SharmaASPLOS 2021 · 223 citations
- Nightcore: efficient and scalable serverless computing for latency-sensitive, interactive microservicesZhipeng Jia, Emmett WitchelASPLOS 2021 · 218 citations
- Caladan: Mitigating Interference at Microsecond TimescalesJoshua Fried, Zhenyuan Ruan, Amy Ousterhout, Adam BelayOSDI 2020 · 213 citations
- FaaSNet: Scalable and Fast Provisioning of Custom Serverless Container Runtimes at Alibaba Cloud Function ComputeAo Wang, Shuai Chang, Huangshi Tian, Hongqi Wang et al.USENIX ATC 2021 · 171 citations
Related papers
- Libra: Harvesting Idle Resources Safely and Timely in Serverless ClustersHanfei Yu, Christian Fontenot, Hao Wang, Jian Li et al.HPDC 2023 · 7 citations
- EcoFaaS: Rethinking the Design of Serverless Environments for Energy EfficiencyJovan Stojkovic, Nikoleta Iliakopoulou, Tianyin Xu, Hubertus Franke et al.ISCA 2024 · 29 citations
- LaSS: Running Latency Sensitive Serverless Computations at the EdgeBin Wang, Ahmed Ali-Eldin, Prashant J. ShenoyHPDC 2021 · 74 citations
- Mosaic: Harnessing the Micro-Architectural Resources of Servers in Serverless EnvironmentsJovan Stojkovic, Esha Choukse, Enrique Saurez, Íñigo Goiri et al.MICRO 2024 · 6 citations
- Litmus: Fair Pricing for Serverless ComputingQi Pei, Yipeng Wang, Seunghee ShinASPLOS 2024 · 1 citation
