One More Config is Enough: Saving (DC)TCP for High-speed Extremely Shallow-buffered Datacenters
Wei Bai, Shuihai Hu, Kai Chen, Kun Tan, Yongqiang Xiong
Abstract
The link speed in production datacenters is growing fast, from 1Gbps to 40Gbps or even 100Gbps. However, the buffer size of commodity switches increases slowly, e.g., from 4MB at 1Gbps to 16MB at 100Gbps, thus significantly outpaced by the link speed. In such extremely shallow-buffered networks, today's TCP/ECN solutions, such as DCTCP, suffer from either excessive packet loss or substantial throughput degradation.To this end, we present BCC1, a simple yet effective solution that requires just one more ECN config (i.e., shared buffer ECN/RED) over prior solutions. BCC operates based on real-time global shared buffer utilization. When available buffer space suffices, BCC delivers both high throughput and low packet loss rate as prior work; Once it gets insufficient, BCC automatically triggers the shared buffer ECN to prevent packet loss at the cost of sacrificing little throughput. BCC is readily deployable with existing commodity switches. We validate BCC's hardware feasibility in a small 100G testbed and evaluate its performance using large-scale simulations. Our results show that BCC maintains low packet loss rate while slightly degrading throughput when the available buffer becomes insufficient. For example, compared to current practice, BCC achieves up to 94.4% lower 99th percentile flow completion time (FCT) for small flows while degrading average FCT for large flows by up to 3%.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Your agent calls
Lunesearch_papers
Free to start. No credit card required.
Terminal
Install the CLIlune papers get fadb4eec-7527-4e55-a977-aba9e046f595Cited by top-tier papers12
- Empowering Azure Storage with RDMAWei Bai, Shanim Sainul Abdeen, Ankit Agrawal, Krishan Kumar Attre et al.NSDI 2023 · 117 citations
- ABM: active buffer management in datacentersVamsi Addanki, Maria Apostolaki, Manya Ghobadi, Stefan Schmid et al.SIGCOMM 2022 · 59 citations
- Towards Domain-Specific Network Transport for Distributed DNN TrainingHao Wang, Han Tian, Jingrong Chen, Xinchen Wan et al.NSDI 2024 · 54 citations
- Reverie: Low Pass Filter-Based Switch Buffer Sharing for Datacenters with RDMA and TCP TrafficVamsi Addanki, Wei Bai, Stefan Schmid, Maria ApostolakiNSDI 2024 · 33 citations
- Credence: Augmenting Datacenter Switch Buffer Sharing with ML PredictionsVamsi Addanki, Maciej Pacut, Stefan SchmidNSDI 2024 · 22 citations
Related papers
- Occamy: A Preemptive Buffer Management for On-chip Shared-memory SwitchesDanfeng Shan, Yunguang Li, Jinchao Ma, Zhenxing Zhang et al.EuroSys 2025 · 5 citations
- A large-scale deployment of DCTCPAbhishek Dhamija, Balasubramanian Madhavan, Hechao Li, Jie Meng et al.NSDI 2024 · 18 citations
- Adapting TCP for Reconfigurable Datacenter NetworksMatthew K. Mukerjee, Christopher Canel, Weiyang Wang, Daehyeok Kim et al.NSDI 2020 · 33 citations
- OSCAR: O(1)-Step Convergence and Readily-deployable Congestion ControlZhaochen Zhang, Feiyang Xue, Rui Ning, Keqiang He et al.NSDI 2026
- Traffic-aware Buffer Management in Shared Memory SwitchesSijiang Huang, Mowei Wang, Yong CuiINFOCOM 2021 · 14 citations
