Byzantine Resilient and Fast Federated Few-Shot Learning
Ankit Pratap Singh, Namrata Vaswani
2024Year
5Citations
1Top-tier citations
Abstract
This work introduces a Byzantine resilient solution for learning low-dimensional linear representation. Our main contribution is the development of a provably Byzantine-resilient Alt-GDmin algorithm for solving this problem in a federated setting. We argue that our solution is sample-efficient, fast, and communicationefficient. In solving this problem, we also introduce a novel secure solution to the federated subspace learning meta-problem that occurs in many different applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers1
Ask how each one uses itBuilds on9
- Exploiting Shared Representations for Personalized Federated LearningLiam Collins, Hamed Hassani, Aryan Mokhtari, Sanjay ShakkottaiICML 2021 · 1,081 citations
- Scaling and Benchmarking Self-Supervised Visual Representation LearningPriya Goyal, Dhruv Mahajan, Abhinav Gupta, Ishan MisraICCV 2019 · 429 citations
- On the Theory of Transfer Learning: The Importance of Task DiversityNilesh Tripuraneni, Michael I. Jordan, Chi JinNeurIPS 2020 · 263 citations
- Transformers as Algorithms: Generalization and Stability in In-context LearningYingcong Li, Muhammed Emrullah Ildiz, Dimitris Papailiopoulos, Samet OymakICML 2023 · 242 citations
- Provable Meta-Learning of Linear RepresentationsNilesh Tripuraneni, Chi Jin, Michael I. JordanICML 2021 · 218 citations
Related papers
- Privately Learning SubspacesVikrant Singhal, Thomas SteinkeNeurIPS 2021 · 23 citations
- High Dimensional Distributed Gradient Descent with Arbitrary Number of Byzantine AttackersWenyu Liu, Tianqiang Huang, Pengfei Zhang, Zong Ke et al.AAAI 2026 · 10 citations
- Byzantine-Resilient High-Dimensional SGD with Local Iterations on Heterogeneous DataDeepesh Data, Suhas N. DiggaviICML 2021 · 49 citations
- Secure Distributed Training at ScaleEduard Gorbunov, Alexander Borzunov, Michael Diskin, Max RyabininICML 2022 · 18 citations
- Collaborative Learning in the Jungle (Decentralized, Byzantine, Heterogeneous, Asynchronous and Nonconvex Learning)El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Arsany Guirguis et al.NeurIPS 2021 · 114 citations
