Lightweight Preemptible Functions
Sol Boucher, Anuj Kalia, David G. Andersen, Michael Kaminsky
Abstract
Lamenting the lack of a natural userland abstraction for preemptive interruption and asynchronous cancellation, we propose lightweight preemptible functions, a mechanism for synchronously performing a function call with a precise timeout that is lightweight, efficient, and composable, all while being portable between programming languages. We present the design of libinger, a library that provides this abstraction, on top of which we build libturquoise, arguably the first generalpurpose and backwards-compatible preemptive thread library implemented entirely in userland. Finally, we demonstrate this software stack's applicability to and performance on the problems of combatting head-ofline blocking and time-based DoS attacks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- Nightcore: efficient and scalable serverless computing for latency-sensitive, interactive microservicesZhipeng Jia, Emmett WitchelASPLOS 2021 · 218 citations
- Bamboo: Making Preemptible Instances Resilient for Affordable Training of Large DNNsJohn Thorpe, Pengzhan Zhao, Jonathan Eyolfson, Yifan Qiao et al.NSDI 2023 · 144 citations
- When Idling is Ideal: Optimizing Tail-Latency for Heavy-Tailed Datacenter Workloads with PerséphoneHenri Maxime Demoulin, Joshua Fried, Isaac Pedisich, Marios Kogias et al.SOSP 2021 · 39 citations
- D3: a dynamic deadline-driven approach for building autonomous vehiclesIonel Gog, Sukrit Kalra, Peter Schafhalter, Joseph E. Gonzalez et al.EuroSys 2022 · 39 citations
- Achieving Microsecond-Scale Tail Latency Efficiently with Approximate Optimal SchedulingRishabh R. Iyer, Musa Unal, Marios Kogias, George CandeaSOSP 2023 · 17 citations
Related papers
- LibPreemptible: Enabling Fast, Adaptive, and Hardware-Assisted User-Space SchedulingYueying Li, Nikita Lazarev, David Koufaty, Tenny Yin et al.HPCA 2024 · 14 citations
- The Benefits and Limitations of User Interrupts for Preemptive Userspace SchedulingLinsong Guo, Danial Zuberi, Tal Garfinkel, Amy OusterhoutNSDI 2025 · 10 citations
- Compiler-based timing for extremely fine-grain preemptive parallelismSouradip Ghosh, Michael Cuevas, Simone Campanoni, Peter A. DindaSC 2020 · 7 citations
- Fast Core Scheduling with Userspace Process AbstractionJiazhen Lin, Youmin Chen, Shiwei Gao, Youyou LuSOSP 2024 · 3 citations
- PeeR: First-Class Scheduling for Latency-Critical eBPF ApplicationsJeremy Carin, Ben Holmes, Weiyang Wang, Ankit Bhardwaj et al.OSDI 2026
