Bine Trees: Enhancing Collective Operations by Optimizing Communication Locality
Daniele De Sensi, Saverio Pasqualoni, Lorenzo Piarulli, Tommaso Bonato, Seydou Ba, Matteo Turisini, Jens Domke, Torsten Hoefler
摘要
Communication locality plays a key role in the performance of collective operations on large HPC systems, especially on oversubscribed networks where groups of nodes are fully connected internally but sparsely linked through global connections. We present Bine (binomial negabinary) trees, a family of collective algorithms that improve communication locality. Bine trees maintain the generality of binomial trees and butterflies while cutting global-link traffic by up to . We implement eight Bine-based collectives and evaluate them on four large-scale supercomputers with Dragonfly, Dragonfly+, oversubscribed fat-tree, and torus topologies, achieving up to 5 × speedups and consistent reductions in global-link traffic across different vector sizes and node counts.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper10
- An in-depth analysis of the slingshot interconnectDaniele De Sensi, Salvatore Di Girolamo, Kim H. McMahon, Duncan Roweth 等SC 2020 · 被引用 122 次
- Frontier: Exploring ExascaleScott Atchley, Christopher Zimmer, John Lange, David E. Bernholdt 等SC 2023 · 被引用 91 次
- Synthesizing optimal collective algorithmsZixian Cai, Zhengyang Liu, Saeed Maleki, Madanlal Musuvathi 等PPoPP 2021 · 被引用 64 次
- Swing: Short-cutting Rings for Higher Bandwidth AllreduceDaniele De Sensi, Tommaso Bonato, David Saam, Torsten HoeflerNSDI 2024 · 被引用 48 次
- TACOS: Topology-Aware Collective Algorithm Synthesizer for Distributed Machine LearningWilliam Won, Midhilesh Elavazhagan, Sudarshan Srinivasan, Swati Gupta 等MICRO 2024 · 被引用 36 次
相关 Paper
- An Evaluation of the Effect of Network Cost Optimization for Leadership Class SupercomputersAwais Khan, John R. Lange, Nick Hagerty, Edwin F. Posada 等SC 2024 · 被引用 4 次
- SuperMesh: Energy-Efficient Collective Communications for AcceleratorsSabuj Laskar, Pranati Majhi, Abdullah Muzahid, Eun Jung KimMICRO 2025 · 被引用 3 次
- Efficient all-to-all Collective Communication Schedules for Direct-connect TopologiesPrithwish Basu, Liangyu Zhao, Jason Fantl, Siddharth Pal 等HPDC 2024 · 被引用 7 次
- Architecture and performance studies of 3D-Hyper-FleX-LION for reconfigurable all-to-all HPC networksGengchen Liu, Roberto Proietti, Marjan Fariborz, Pouya Fotouhi 等SC 2020 · 被引用 21 次
- Communication Algorithm-Architecture Co-Design for Distributed Deep LearningJiayi Huang, Pritam Majumder, Sungkeun Kim, Abdullah Muzahid 等ISCA 2021 · 被引用 44 次
