Remote TCP Connection Offload and Applications
Shuo Li, Steven W. D. Chien, Tianyi Gao, Michio Honda
Abstract
Layer 7 load balancers (L7LBs) play an important role in perrequest server selection within long-lived connections and transport-or application-layer protocol translation. However, L7LBs introduce substantial CPU and network overhead.
We present XO, which enables an L7LB to offload transport-layer and application request processing to backend servers at request granularity. XO outperforms conventional L7LBs by 27-365 % in throughput through efficient utilization of server CPU and network resources. We apply XO to two real-world applications, Ceph and nginx, improving throughput by up to 135 % and 300 %, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on19
- Efficient Memory Management for Large Language Model Serving with PagedAttentionWoosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng et al.SOSP 2023 · 1,016 citations
- AccelTCP: Accelerating Network Applications with Stateful TCP OffloadingYoungGyoun Moon, SeungEon Lee, Muhammad Asim Jamshed, KyoungSoo ParkNSDI 2020 · 121 citations
- A High-Speed Load-Balancer Design with Guaranteed Per-Connection-ConsistencyTom Barbette, Chen Tang, Haoran Yao, Dejan Kostic et al.NSDI 2020 · 100 citations
- Making Kernel Bypass Practical for the Cloud with JunctionJoshua Fried, Gohar Irfan Chaudhry, Enrique Saurez, Esha Choukse et al.NSDI 2024 · 57 citations
- Sketchovsky: Enabling Ensembles of Sketches on Programmable SwitchesHun Namkung, Zaoxing Liu, Daehyeok Kim, Vyas Sekar et al.NSDI 2023 · 44 citations
Related papers
- Miresga: Accelerating Layer-7 Load Balancing with Programmable SwitchesXiaoyi Shi, Lin He, Jiasheng Zhou, Yifan Yang et al.WWW 2025 · 3 citations
- Turbo: SmartNIC-enabled Dynamic Load Balancing of µs-scale RPCsHamed Seyedroudbari, Srikar Vanavasam, Alexandros DaglisHPCA 2023 · 12 citations
- QDSR: Accelerating Layer-7 Load Balancing by Direct Server Return with QUICZiqi Wei, Zhiqiang Wang, Qing Li, Yuan Yang et al.USENIX ATC 2024 · 10 citations
- Hermes: Enhancing Layer-7 Cloud Load Balancers with Userspace-Directed I/O Event NotificationTian Pan, Enge Song, Yueshang Zuo, Shaokai Zhang et al.SIGCOMM 2025 · 5 citations
- DISC: Backpressure Mitigation In Multi-tier Applications With Distributed Shared ConnectionBrice Ekane, Djob Mvondo, Renaud Lachaize, Yérom-David Bromberg et al.NSDI 2025 · 2 citations
