Federated Bilevel Performative Prediction
Liangxin Qian, Chang Liu, Xuanyu Cao, Jun Zhao, Kwok Yan Lam
摘要
Federated bilevel optimization is widely used for nested learning problems across distributed clients, such as federated hyperparameter tuning and meta-learning under privacy and communication constraints. Most existing formulations assume fixed client data distributions, which can be violated by performativity, where deployed decisions reshape client behavior and data collection, inducing client-specific, decision-dependent distribution shift. We study federated bilevel performative prediction, where both upper-level (UL) and lower-level (LL) objectives are evaluated under client-dependent, decision-dependent distributions. We formalize the federated bilevel performatively stable (FBPS) point under a decoupled-risk perspective and provide sufficient conditions for its existence and uniqueness. We then develop two federated methods to compute the FBPS solution: FBi-RRM, which converges linearly under a contraction condition, and FBi-SGD, a communication-efficient stochastic method based on federated hypergradient estimation with convergence guarantees under diminishing step sizes when sensitivities are sufficiently small. Experiments on strategic regression and meta strategic classification validate the predicted stability thresholds and demonstrate improved meta-generalization over non-performative baselines, and CNN-based classification further demonstrates the practical effectiveness of the proposed methods in nonconvex neural network settings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Performative PredictionJuan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz HardtICML 2020 · 被引用 422 次
- Stochastic Optimization for Performative PredictionCelestine Mendler-Dünner, Juan C. Perdomo, Tijana Zrnic, Moritz HardtNeurIPS 2020 · 被引用 161 次
- Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-SharingMikhail Khodak, Renbo Tu, Tian Li, Liam Li 等NeurIPS 2021 · 被引用 111 次
- Strategic Classification in the DarkGanesh Ghalme, Vineet Nair, Itay Eilat, Inbal Talgam-Cohen 等ICML 2021 · 被引用 70 次
- Strategic Classification Made PracticalSagi Levanon, Nir RosenfeldICML 2021 · 被引用 68 次
相关 Paper
- Bilevel Optimization with Coupled Decision-Dependent DistributionsSongtao LuICML 2023 · 被引用 15 次
- Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution ShiftsKun Jin, Tongxin Yin, Zhongzhu Chen, Zeyu Sun 等AAAI 2024 · 被引用 15 次
- FedNest: Federated Bilevel, Minimax, and Compositional OptimizationDavoud Ataee Tarzanagh, Mingchen Li, Christos Thrampoulidis, Samet OymakICML 2022 · 被引用 85 次
- First-Order Federated Bilevel LearningYifan Yang, Peiyao Xiao, Shiqian Ma, Kaiyi JiAAAI 2025 · 被引用 4 次
- Stochastic Optimization Schemes for Performative Prediction with Nonconvex LossQiang Li, Hoi-To WaiNeurIPS 2024 · 被引用 18 次
