Distributed Experimental Design Networks
Yuanyuan Li, Lili Su, Carlee Joe-Wong, Edmund Yeh, Stratis Ioannidis
摘要
As edge computing capabilities increase, model learning deployments in diverse edge environments have emerged. In experimental design networks, introduced recently, network routing and rate allocation are designed to aid the transfer of data from sensors to heterogeneous learners. We design efficient experimental design network algorithms that are (a) distributed and (b) use multicast transmissions. This setting poses significant challenges as classic decentralization approaches often operate on (strictly) concave objectives under differentiable constraints. In contrast, the problem we study here has a non-convex, continuous DR-submodular objective, while multicast transmissions naturally result in non-differentiable constraints. From a technical standpoint, we propose a distributed Frank-Wolfe and a distributed projected gradient ascent algorithm that, coupled with a relaxation of non-differentiable constraints, yield allocations within a 1 − 1/e factor from the optimal. Numerical evaluations show that our proposed algorithms outperform competitors with respect to model learning quality.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper1
相关 Paper
- Communication-Efficient Frank-Wolfe Algorithm for Nonconvex Decentralized Distributed LearningWenhan Xian, Feihu Huang, Heng HuangAAAI 2021 · 被引用 17 次
- Multi-Level Local SGD: Distributed SGD for Heterogeneous Hierarchical NetworksTimothy Castiglia, Anirban Das, Stacy PattersonICLR 2021 · 被引用 11 次
- Towards Faster Decentralized Stochastic Optimization with Communication CompressionRustem Islamov, Yuan Gao, Sebastian U. StichICLR 2025
- Joint Optimization of Signal Design and Resource Allocation in Wireless D2D Edge ComputingJunghoon Kim, Taejoon Kim, Morteza Hashemi, Christopher G. Brinton 等INFOCOM 2020 · 被引用 32 次
- Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical FeaturesAleksandr Beznosikov, David Dobre, Gauthier GidelICML 2024 · 被引用 9 次
