Distributed Experimental Design Networks
Yuanyuan Li, Lili Su, Carlee Joe-Wong, Edmund Yeh, Stratis Ioannidis
Abstract
As edge computing capabilities increase, model learning deployments in diverse edge environments have emerged. In experimental design networks, introduced recently, network routing and rate allocation are designed to aid the transfer of data from sensors to heterogeneous learners. We design efficient experimental design network algorithms that are (a) distributed and (b) use multicast transmissions. This setting poses significant challenges as classic decentralization approaches often operate on (strictly) concave objectives under differentiable constraints. In contrast, the problem we study here has a non-convex, continuous DR-submodular objective, while multicast transmissions naturally result in non-differentiable constraints. From a technical standpoint, we propose a distributed Frank-Wolfe and a distributed projected gradient ascent algorithm that, coupled with a relaxation of non-differentiable constraints, yield allocations within a 1 − 1/e factor from the optimal. Numerical evaluations show that our proposed algorithms outperform competitors with respect to model learning quality.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on1
Related papers
- Communication-Efficient Frank-Wolfe Algorithm for Nonconvex Decentralized Distributed LearningWenhan Xian, Feihu Huang, Heng HuangAAAI 2021 · 17 citations
- Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical NetworksTimothy Castiglia, Anirban Das, Stacy PattersonICLR 2021 · 11 citations
- Towards Faster Decentralized Stochastic Optimization with Communication CompressionRustem Islamov, Yuan Gao, Sebastian U. StichICLR 2025
- Joint Optimization of Signal Design and Resource Allocation in Wireless D2D Edge ComputingJunghoon Kim, Taejoon Kim, Morteza Hashemi, Christopher G. Brinton et al.INFOCOM 2020 · 32 citations
- Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical FeaturesAleksandr Beznosikov, David Dobre, Gauthier GidelICML 2024 · 9 citations
