Evolutionary Prediction Games
Eden Saig, Nir Rosenfeld
Abstract
When a prediction algorithm serves a collection of users, disparities in prediction quality are likely to emerge. If users respond to accurate predictions by increasing engagement, inviting friends, or adopting trends, repeated learning creates a feedback loop that shapes both the model and the population of its users. In this work, we introduce evolutionary prediction games, a framework grounded in evolutionary game theory which models such feedback loops as natural-selection processes among groups of users. Our theoretical analysis reveals a gap between idealized and real-world learning settings: In idealized settings with unlimited data and computational power, repeated learning creates competition and promotes competitive exclusion across a broad class of behavioral dynamics. However, under realistic constraints such as finite data, limited compute, or risk of overfitting, we show that stable coexistence and mutualistic symbiosis between groups becomes possible. We analyze these possibilities in terms of their stability and feasibility, present mechanisms that can sustain their existence, and empirically demonstrate our findings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on13
- Retiring Adult: New Datasets for Fair Machine LearningFrances Ding, Moritz Hardt, John Miller, Ludwig SchmidtNeurIPS 2021 · 671 citations
- Performative PredictionJuan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz HardtICML 2020 · 422 citations
- Change is Hard: A Closer Look at Subpopulation ShiftYuzhe Yang, Haoran Zhang, Dina Katabi, Marzyeh GhassemiICML 2023 · 149 citations
- Outside the Echo Chamber: Optimizing the Performative RiskJohn Miller, Juan C. Perdomo, Tijana ZrnicICML 2021 · 128 citations
- Estimating and Penalizing Induced Preference Shifts in Recommender SystemsMicah D. Carroll, Anca D. Dragan, Stuart Russell, Dylan Hadfield-MenellICML 2022 · 49 citations
Related papers
- Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum GamesStratis Skoulakis, Tanner Fiez, Ryann Sim, Georgios Piliouras et al.AAAI 2021 · 17 citations
- Classification Under Strategic Self-SelectionGuy Horowitz, Yonatan Sommer, Moran Koren, Nir RosenfeldICML 2024 · 8 citations
- Improved Bayes Risk Can Yield Reduced Social Welfare Under CompetitionMeena Jagadeesan, Michael I. Jordan, Jacob Steinhardt, Nika HaghtalabNeurIPS 2023 · 20 citations
- Strategic Distribution Shift of Interacting Agents via Coupled Gradient FlowsLauren E. Conger, Franca Hoffmann, Eric Mazumdar, Lillian J. RatliffNeurIPS 2023 · 7 citations
- Unintended Selection: Persistent Qualification Rate Disparities and InterventionsReilly Raab, Yang LiuNeurIPS 2021 · 27 citations
