Federated Bilevel Performative Prediction
Liangxin Qian, Chang Liu, Xuanyu Cao, Jun Zhao, Kwok Yan Lam
Abstract
Federated bilevel optimization is widely used for nested learning problems across distributed clients, such as federated hyperparameter tuning and meta-learning under privacy and communication constraints. Most existing formulations assume fixed client data distributions, which can be violated by performativity, where deployed decisions reshape client behavior and data collection, inducing client-specific, decision-dependent distribution shift. We study federated bilevel performative prediction, where both upper-level (UL) and lower-level (LL) objectives are evaluated under client-dependent, decision-dependent distributions. We formalize the federated bilevel performatively stable (FBPS) point under a decoupled-risk perspective and provide sufficient conditions for its existence and uniqueness. We then develop two federated methods to compute the FBPS solution: FBi-RRM, which converges linearly under a contraction condition, and FBi-SGD, a communication-efficient stochastic method based on federated hypergradient estimation with convergence guarantees under diminishing step sizes when sensitivities are sufficiently small. Experiments on strategic regression and meta strategic classification validate the predicted stability thresholds and demonstrate improved meta-generalization over non-performative baselines, and CNN-based classification further demonstrates the practical effectiveness of the proposed methods in nonconvex neural network settings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c143a1e6-4854-4b3a-a49f-24876ce1dee5Builds on19
- Performative PredictionJuan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz HardtICML 2020 · 422 citations
- Stochastic Optimization for Performative PredictionCelestine Mendler-Dünner, Juan C. Perdomo, Tijana Zrnic, Moritz HardtNeurIPS 2020 · 161 citations
- Federated Hyperparameter Tuning: Challenges, Baselines, and Connections to Weight-SharingMikhail Khodak, Renbo Tu, Tian Li, Liam Li et al.NeurIPS 2021 · 111 citations
- Strategic Classification in the DarkGanesh Ghalme, Vineet Nair, Itay Eilat, Inbal Talgam-Cohen et al.ICML 2021 · 70 citations
- Strategic Classification Made PracticalSagi Levanon, Nir RosenfeldICML 2021 · 68 citations
Related papers
- Bilevel Optimization with Coupled Decision-Dependent DistributionsSongtao LuICML 2023 · 15 citations
- Performative Federated Learning: A Solution to Model-Dependent and Heterogeneous Distribution ShiftsKun Jin, Tongxin Yin, Zhongzhu Chen, Zeyu Sun et al.AAAI 2024 · 15 citations
- FedNest: Federated Bilevel, Minimax, and Compositional OptimizationDavoud Ataee Tarzanagh, Mingchen Li, Christos Thrampoulidis, Samet OymakICML 2022 · 85 citations
- First-Order Federated Bilevel LearningYifan Yang, Peiyao Xiao, Shiqian Ma, Kaiyi JiAAAI 2025 · 4 citations
- Stochastic Optimization Schemes for Performative Prediction with Nonconvex LossQiang Li, Hoi-To WaiNeurIPS 2024 · 18 citations
