Orderlock: A New Type of Deadlock and its Implications on High Performance Network Protocol Design
Weihao Jiang, Wenli Xiao, Yuqing Yang, Peirui Cao, Shizhen Zhao
Abstract
In the pursuit of designing high-performance network (HPN) protocols, three critical features for effective transmission have been extensively studied: In-order Delivery, Lossless Transmission, and Out-of-order Capability. However, no practical implementation has successfully achieved all three simultaneously. We identify and prove that the simultaneous realization of these features constitutes a necessary and sufficient condition for a new type of deadlock, which we term Orderlock. We demonstrate that operating in an Orderlock-risky network is impractical and conduct a comprehensive exploration and comparison of Orderlock-free protocols, through a case study tuning AI workload performance. From an Orderlock-prevention perspective, our findings provide insights into the requirements for future HPN protocol and hardware designs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bf2a0c37-a70e-48fa-baaa-1191589db35cBuilds on13
- Jupiter evolving: transforming google's datacenter network via optical circuit switches and software-defined networkingLeon Poutievski, Omid Mashayekhi, Joon Ong, Arjun Singh et al.SIGCOMM 2022 · 230 citations
- Alibaba HPN: A Data Center Network for Large Language Model TrainingKun Qian, Yongqing Xi, Jiamin Cao, Jiaqi Gao et al.SIGCOMM 2024 · 173 citations
- RDMA over Ethernet for Distributed Training at Meta ScaleAdithya Gangidi, Rui Miao, Shengbao Zheng, Sai Jayesh Bondu et al.SIGCOMM 2024 · 171 citations
- SRNIC: A Scalable Architecture for RDMA NICsZilong Wang, Layong Luo, Qingsong Ning, Chaoliang Zeng et al.NSDI 2023 · 154 citations
- Understanding host network stack overheadsQizhe Cai, Shubham Chaudhary, Midhul Vuppalapati, Jaehyun Hwang et al.SIGCOMM 2021 · 150 citations
Related papers
- Scalable RDMA-accelerated Distributed Locks with Shared Stream AbstractionMiao Cai, Junru Shen, Xiaojian Liao, Rong Gu et al.EuroSys 2026
- Pitstop: Enabling a Virtual Network Free Network-on-ChipHossein Farrokhbakht, Henry Kao, Kamran Hasan, Paul V. Gratz et al.HPCA 2021 · 29 citations
- VVQ: Virtualizing Virtual Channel for Cost-Efficient Protocol Deadlock AvoidanceHans Kasan, John KimHPCA 2023 · 3 citations
- Scheduling and analysis of real-time tasks with parallel critical sectionsYang Wang, Xu Jiang, Nan Guan, Mingsong Lv et al.DAC 2022 · 3 citations
- DRAIN: Deadlock Removal for Arbitrary Irregular NetworksMayank Parasar, Hossein Farrokhbakht, Natalie D. Enright Jerger, Paul V. Gratz et al.HPCA 2020 · 34 citations
