Express Lane to Efficiency and Reliability: Multi-Dimensional Control in Meta's Express Backbone Network
Faisal Iqbal, Vitaly Neganov, Brian Chang, Rong Rong, Yuanjun Yao, Marek Denis, Qin Zhang, Alexandru Manea, Anton Marchenko, Ulas Kozat, Aditya Akella, Ying Zhang
Abstract
Meta's Express Backbone (EBB) network interconnects data centers across the globe. As such, it is one of the largest WANs in terms of capacity, traffic and global reach. EBB's unique multi-plane Software Defined Network (SDN) architecture has passed the test of time with its flexibility, reliability and performance. Nonetheless, in parallel to its success, it has also seen an unprecedented growth in traffic demand and capacity footprint. Along with the rapid rise of AI workloads, challenges in resource utilization and failure recovery started to emerge, driving us to enhance and evolve EBB's control design to increase its efficiency and resiliency. From our operational experiences, we realize that while foundational perplane Traffic Engineering (TE) control offers simplicity, there still exists a gap to support the above two goals. We propose to introduce control in two additional dimensions: globally across planes and locally at individual device. Specifically, Unequal Cost Multi-Path (UCMP) enables control across planes for efficient load balancing, and Fast Re-Route (FRR) provides control across time slices for facilitating rapid detection and recovery from failures. We present the design, implementation, and production results of UCMP and FRR, demonstrating how EBB can adapt to AI-era demands rapidly without fundamental architectural changes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 015ecbfa-d117-48d6-a4be-163984314bd3Builds on4
- EBB: Reliable and Evolvable Express Backbone Network in MetaMarek Denis, Yuanjun Yao, Ashley Hatch, Qin Zhang et al.SIGCOMM 2023 · 25 citations
- Network entitlement: contract-based network sharing with agility and SLO guaranteesSatyajeet Singh Ahuja, Vinayak Dangui, Kirtesh Patil, Manikandan Somasundaram et al.SIGCOMM 2022 · 3 citations
- Centralium: A Hybrid Route-Planning Framework for Large-Scale Data Center Network MigrationsYikai Lin, Mohab Gawish, Shih-Hao Tseng, Lixin Gao et al.SIGCOMM 2025 · 2 citations
- Decentralized cloud wide-area network traffic engineering with BLASTSHIELDUmesh Krishnaswamy, Rachee Singh, Nikolaj S. Bjørner, Himanshu RajNSDI 2022
Related papers
- Uniform-Cost Multi-Path Routing for Reconfigurable Data Center NetworksJialong Li, Haotian Gong, Federico De Marchi, Aoyu Gong et al.SIGCOMM 2024 · 14 citations
- ARES: Predictable Traffic Engineering under Controller Failures in SD-WANsSongshi Dou, Li Qi, Zehua GuoWWW 2024 · 4 citations
- REPS: Recycled Entropy Packet Spraying for Adaptive Load Balancing and Failure MitigationTommaso Bonato, Abdul Kabbani, Ahmad Ghalayini, Michael Papamichael et al.EuroSys 2026 · 12 citations
- OneWAN is better than two: Unifying a split WAN architectureUmesh Krishnaswamy, Rachee Singh, Paul Mattes, Paul-Andre C. Bissonnette et al.NSDI 2023 · 34 citations
- FlexWAN: Software Hardware Co-design for Cost-Effective and Resilient Optical BackbonesCongcong Miao, Zhizhen Zhong, Ying Zhang, Kunling He et al.SIGCOMM 2023 · 10 citations
