Detecting and Resolving PFC Deadlocks with ITSY Entirely in the Data Plane
Xinyu Crystal Wu, T. S. Eugene Ng
Abstract
The Priority-based Flow Control (PFC) protocol is adopted to guarantee zero packet loss in many high-performance data centers. PFC, however, can induce deadlocks and in severe cases cause the entire network to be blocked. Existing solutions have focused on deadlock avoidance; unfortunately, they are not foolproof. Therefore, deadlock detection is a necessity. We propose ITSY, a novel system that correctly detects and resolves deadlocks entirely in the data plane. It works with any network topologies and routing algorithms. Unique to ITSY is the use of deadlock initial triggers, which contributes to efficient deadlock detection, mitigation, and recurrence prevention. ITSY provides three deadlock resolution mechanisms with different trade-off options. We implement ITSY for programmable switches in the P4 language. Experiments show that ITSY detects and resolves deadlocks rapidly with minimal overheads.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Empowering Azure Storage with RDMAWei Bai, Shanim Sainul Abdeen, Ankit Agrawal, Krishan Kumar Attre et al.NSDI 2023 · 117 citations
- Flattened Clos: Designing High-performance Deadlock-free Expander Data Center Networks Using Graph ContractionShizhen Zhao, Qizhou Zhang, Peirui Cao, Xiao Zhang et al.NSDI 2023 · 9 citations
- Hawkeye: Diagnosing RDMA Network Performance Anomalies with PFC ProvenanceShicheng Wang, Menghao Zhang, Xiao Li, Qiyang Peng et al.SIGCOMM 2025 · 7 citations
Builds on5
- Re-architecting Congestion Management in Lossless EthernetWenxue Cheng, Kun Qian, Wanchun Jiang, Tong Zhang et al.NSDI 2020 · 100 citations
- Programmable packet scheduling with a single queueZhuolong Yu, Chuheng Hu, Jingfeng Wu, Xiao Sun et al.SIGCOMM 2021 · 100 citations
- Understanding, Detecting and Localizing Partial Failures in Large System SoftwareChang Lou, Peng Huang, Scott SmithNSDI 2020 · 88 citations
- Config2Spec: Mining Network Specifications from Network ConfigurationsRüdiger Birkner, Dana Drachsler-Cohen, Laurent Vanbever, Martin T. VechevNSDI 2020 · 67 citations
- Finding Network Misconfigurations by Automatic Template InferenceSiva Kesava Reddy K., Alan Tang, Ryan Beckett, Karthick Jayaraman et al.NSDI 2020 · 53 citations
Related papers
- Pitstop: Enabling a Virtual Network Free Network-on-ChipHossein Farrokhbakht, Henry Kao, Kamran Hasan, Paul V. Gratz et al.HPCA 2021 · 29 citations
- Towards timeout-less transport in commodity datacenter networksHwijoon Lim, Wei Bai, Yibo Zhu, Youngmok Jung et al.EuroSys 2021 · 28 citations
- FLB: Fine-grained Load Balancing for Lossless Datacenter NetworksJinbin Hu, Wenxue Li, Xiangzhou Liu, Junfeng Wang et al.USENIX ATC 2025 · 10 citations
- NetRT: Enhancing RDMA with Retransmission Offloading in Data Center NetworksWentao Wang, Jiangping Han, Kaiping Xue, Jian Li et al.INFOCOM 2025 · 3 citations
- DRAIN: Deadlock Removal for Arbitrary Irregular NetworksMayank Parasar, Hossein Farrokhbakht, Natalie D. Enright Jerger, Paul V. Gratz et al.HPCA 2020 · 34 citations
