Tux: Efficient Drop-in Networking for Database Systems
Xinjing Zhou, Viktor Leis, Xiangyao Yu, Michael Stonebraker
Abstract
Modern high-performance OLTP systems are increasingly bottle-necked by kernel network stack and the high cost of dispatching requests to database worker threads. While kernel-bypass TCP stacks improve performance, they often sacrifice compatibility and robustness, in addition to leaving performance opportunities on the table due to TCP's byte-stream interface. We present Tux , a kernel-bypass networking stack designed for database systems that achieves high performance without giving up compatibility and robustness. TUX addresses these challenges by (1) introducing a message-based transport protocol that decouples reliability from in-order delivery and natively preserves message boundaries without framing or copy overhead inherent in byte-stream interface; (2) providing a flexible pushdown abstraction that lets database engines execute DBMS-specific logic closer to the NIC to avoid context-switch overhead and to exploit message-based interface; and (3) leveraging eBPF/XDP to reuse well-maintained kernel NIC drivers for compatibility and operational ease. We implement TUX in a library called LIBTUX, offering both zero-change "compatibility" mode and minimal-change "pushdown" mode. Our implementation, LIBTUX, evaluated on VoltDB, Redis, ScyllaDB, Memcached, and LeanStore, improves throughput up to 2.3x, reduces median and 99th percentile latencies by up to 2.6x and 4.7x, compared to existing kernel-bypass systems with minimal modifications to the evaluated DBMSes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4b9831e2-d0c8-49b9-80ab-acf9f50082c9Builds on13
- Caladan: Mitigating Interference at Microsecond TimescalesJoshua Fried, Zhenyuan Ruan, Amy Ousterhout, Adam BelayOSDI 2020 · 213 citations
- The Demikernel Datapath OS Architecture for Microsecond-scale Datacenter SystemsIrene Zhang, Amanda Raybuck, Pratyush Patel, Kirk Olynyk et al.SOSP 2021 · 83 citations
- BMC: Accelerating Memcached using Safe In-kernel Caching and Pre-stack ProcessingYoann Ghigoff, Julien Sopena, Kahina Lazri, Antoine Blin et al.NSDI 2021 · 79 citations
- Making Kernel Bypass Practical for the Cloud with JunctionJoshua Fried, Gohar Irfan Chaudhry, Enrique Saurez, Esha Choukse et al.NSDI 2024 · 57 citations
- CoroBase: Coroutine-Oriented Main-Memory Database EngineYongjun He, Jiacheng Lu, Tianzheng WangVLDB 2021 · 42 citations
Related papers
- DINT: Fast In-Kernel Distributed Transactions with eBPFYang Zhou, Xingyu Xiang, Matthew Kiley, Sowmya Dharanipragada et al.NSDI 2024 · 40 citations
- Tigger: A Database Proxy That Bounces With User-BypassMatthew Butrovich, Karthik Ramanathan, John Rollinson, Wan Shen Lim et al.VLDB 2023 · 17 citations
- Low-Latency Communication for Fast DBMS Using RDMA and Shared MemoryPhilipp Fent, Alexander van Renen, Andreas Kipf, Viktor Leis et al.ICDE 2020 · 44 citations
- In-Network Support for Transaction TriagingTheo Jepsen, Alberto Lerner, Fernando Pedone, Robert Soulé et al.VLDB 2021 · 19 citations
- The Art of Latency Hiding in Modern Database EnginesKaisong Huang, Tianzheng Wang, Qingqing Zhou, Qingzhong MengVLDB 2024 · 23 citations
