Addressing Polarization and Unfairness in Performative Prediction
Kun Jin, Tian Xie, Yang Liu, Xueru Zhang
Abstract
In many real-world applications of machine learning-such as recommendations, hiring, and lending-deployed models influence the data they are trained on, leading to feedback loops between predictions and data distribution. The performative prediction (PP) framework captures this phenomenon by modeling the data distribution as a function of the deployed model. While prior work has focused on finding performative stable (PS) solutions for robustness, their societal impacts, particularly regarding fairness, remain underexplored. We show that PS solutions can lead to severe polarization and prediction performance disparities, and that conventional fairness interventions in previous works often fail under model-dependent distribution shifts due to failing the PS criteria. To address these challenges in PP, we introduce novel fairness mechanisms that provably ensure both stability and fairness, validated by theoretical analysis and empirical results 1
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- Benchmarking Bias Mitigation Toward Fairness Without Harm from Vision to LVLMsXuwei Tan, Ziyu Hu, Xueru ZhangICLR 2026 · 4 citations
- Market Games for Generative Models: Equilibria, Welfare, and Strategic EntryXiukun Wei, Min Shi, Xueru ZhangICLR 2026 · 2 citations
- Observations and Remedies for Large Language Model Bias in Self-Consuming Performative LoopYaxuan Wang, Zhongteng Cai, Yujia Bao, Xueru Zhang et al.ACL 2026 · 1 citation
- Multi-Level Strategic Classification: Incentivizing Improvement through Promotion and Relegation DynamicsZiyuan Huang, Lina Alkarmi, Mingyan LiuICML 2026 · 1 citation
- When and How Human Curation Backfires: Preference Alignment under Multi-Model Self-Consuming LoopYang Zhang, Xiukun Wei, Xueru ZhangICML 2026
Builds on14
- Retiring Adult: New Datasets for Fair Machine LearningFrances Ding, Moritz Hardt, John Miller, Ludwig SchmidtNeurIPS 2021 · 671 citations
- Performative PredictionJuan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz HardtICML 2020 · 422 citations
- Minimax Pareto Fairness: A Multi Objective PerspectiveNatalia Martínez, Martín Bertrán, Guillermo SapiroICML 2020 · 232 citations
- Outside the Echo Chamber: Optimizing the Performative RiskJohn Miller, Juan C. Perdomo, Tijana ZrnicICML 2021 · 128 citations
- How to Learn when Data Reacts to Your Model: Performative Gradient DescentZachary Izzo, Lexing Ying, James ZouICML 2021 · 97 citations
Related papers
- Decentralized Noncooperative Games with Coupled Decision-Dependent DistributionsWenjing Yan, Xuanyu CaoNeurIPS 2024 · 4 citations
- Distributionally Robust Performative PredictionSongkai Xue, Yuekai SunNeurIPS 2024 · 9 citations
- Stochastic Optimization Schemes for Performative Prediction with Nonconvex LossQiang Li, Hoi-To WaiNeurIPS 2024 · 18 citations
- On the Impact of Performative Risk Minimization for Binary Random VariablesNikita Tsoy, Ivan Kirev, Negin Rahimiyazdi, Nikola KonstantinovICML 2025
- Performative Prediction with Bandit Feedback: Learning through ReparameterizationYatong Chen, Wei Tang, Chien-Ju Ho, Yang LiuICML 2024 · 13 citations
