Assisted Learning: A Framework for Multi-Organization Learning
Xun Xian, Xinran Wang, Jie Ding, Reza Ghanadan
Abstract
In an increasing number of AI scenarios, collaborations among different organizations or agents (e.g., human and robots, mobile units) are often essential to accomplish an organization-specific mission. However, to avoid leaking useful and possibly proprietary information, organizations typically enforce stringent security constraints on sharing modeling algorithms and data, which significantly limits collaborations. In this work, we introduce the Assisted Learning framework for organizations to assist each other in supervised learning tasks without revealing any organization's algorithm, data, or even task. An organization seeks assistance by broadcasting task-specific but nonsensitive statistics and incorporating others' feedback in one or more iterations to eventually improve its predictive performance. Theoretical and experimental studies, including real-world medical benchmarks, show that Assisted Learning can often achieve near-oracle learning performance as if data and training processes were centralized.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6c87e01d-c09e-4f7b-94de-539806c6a15aCited by top-tier papers6
- HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous ClientsEnmao Diao, Jie Ding, Vahid TarokhICLR 2021 · 179 citations
- Self-Aware Personalized Federated LearningHuili Chen, Jie Ding, Eric W. Tramel, Shuang Wu et al.NeurIPS 2022 · 37 citations
- A Unified Detection Framework for Inference-Stage Backdoor DefensesXun Xian, Ganghua Wang, Jayanth Srinivasa, Ashish Kundu et al.NeurIPS 2023 · 18 citations
- GAL: Gradient Assisted Learning for Decentralized Multi-Organization CollaborationsEnmao Diao, Jie Ding, Vahid TarokhNeurIPS 2022 · 17 citations
- VertiBench: Advancing Feature Distribution Diversity in Vertical Federated Learning BenchmarksZhaomin Wu, Junyi Hou, Bingsheng HeICLR 2024 · 7 citations
Builds on5
- SecureML: A System for Scalable Privacy-Preserving Machine LearningPayman Mohassel, Yupeng ZhangS&P 2017 · 2,107 citations
- Stealing Machine Learning Models via Prediction APIsFlorian Tramèr, Fan Zhang, Ari Juels, Michael K. Reiter et al.USENIX Security 2016 · 2,088 citations
- HeteroFL: Computation and Communication Efficient Federated Learning for Heterogeneous ClientsEnmao Diao, Jie Ding, Vahid TarokhICLR 2021 · 179 citations
- Information Laundering for Model PrivacyXinran Wang, Yu Xiang, Jun Gao, Jie DingICLR 2021 · 24 citations
- Exploring Connections Between Active Learning and Model ExtractionVarun Chandrasekaran, Kamalika Chaudhuri, Irene Giacomelli, Somesh Jha et al.USENIX Security 2020
Related papers
- Confederated Learning: Going Beyond CentralizationZitai Wang, Qianqian Xu, Ke Ma, Xiaochun Cao et al.ACM MM 2022 · 1 citation
- Helen: Maliciously Secure Coopetitive Learning for Linear ModelsWenting Zheng, Raluca Ada Popa, Joseph E. Gonzalez, Ion StoicaS&P 2019 · 161 citations
- A Kernel Perspective on Distillation-based Collaborative LearningSejun Park, Kihun Hong, Ganguk HwangNeurIPS 2024 · 3 citations
- Human Expertise in Algorithmic PredictionRohan Alur, Manish Raghavan, Devavrat ShahNeurIPS 2024 · 18 citations
- Learning Altruistic Behaviours in Reinforcement Learning without External RewardsTim Franzmeyer, Mateusz Malinowski, João F. HenriquesICLR 2022 · 10 citations
