Byzantine Resilient and Fast Federated Few-Shot Learning
Ankit Pratap Singh, Namrata Vaswani
2024年份
5被引次数
1顶会引用
摘要
This work introduces a Byzantine resilient solution for learning low-dimensional linear representation. Our main contribution is the development of a provably Byzantine-resilient Alt-GDmin algorithm for solving this problem in a federated setting. We argue that our solution is sample-efficient, fast, and communicationefficient. In solving this problem, we also introduce a novel secure solution to the federated subspace learning meta-problem that occurs in many different applications.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper9
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 被引用 1,081 次
- Scaling and Benchmarking Self-Supervised Visual Representation LearningPriya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan MisraICCV 2019 · 被引用 429 次
- On the Theory of Transfer Learning: The Importance of Task DiversityNilesh Tripuraneni, Michael I. Jordan, Chi JinNeurIPS 2020 · 被引用 263 次
- Transformers as Algorithms: Generalization and Stability in In-context LearningYingcong Li, Muhammed Emrullah Ildiz, Dimitris Papailiopoulos, Samet OymakICML 2023 · 被引用 242 次
- Provable Meta-Learning of Linear RepresentationsNilesh Tripuraneni, Chi Jin, Michael I. JordanICML 2021 · 被引用 218 次
相关 Paper
- Privately Learning SubspacesVikrant Singhal, Thomas SteinkeNeurIPS 2021 · 被引用 23 次
- High Dimensional Distributed Gradient Descent with Arbitrary Number of Byzantine AttackersWenyu Liu, Tianqiang Huang, Pengfei Zhang, Zong Ke 等AAAI 2026 · 被引用 10 次
- Byzantine-Resilient High-Dimensional SGD with Local Iterations on Heterogeneous DataDeepesh Data, Suhas N. DiggaviICML 2021 · 被引用 49 次
- Secure Distributed Training at ScaleEduard Gorbunov, Alexander Borzunov, Michael Diskin, Max RyabininICML 2022 · 被引用 18 次
- Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis 等NeurIPS 2021 · 被引用 114 次
