Lower Bias, Higher Welfare: How Creator Competition Reshapes Bias-Variance Tradeoff in Recommendation Platforms?
Kang Wang, Renzhe Xu, Bo Li
Abstract
Understanding the bias-variance tradeoff in user representation learning is essential for improving recommendation quality in modern content platforms. While well studied in static settings, this tradeoff becomes significantly more complex when content creators strategically adapt to platform incentives. To analyze how such competition reshapes the tradeoff for maximizing user welfare, we introduce the Content Creator Competition with Bias-Variance Tradeoff (C 3 BV ) framework, a tractable game-theoretic model that captures the platform's decision on regularization strength in user feature estimation. We derive and compare the platform's optimal policy under two key settings: a non-strategic baseline with fixed content and a strategic environment where creators compete in response to the platform's algorithmic design. Our theoretical analysis in a stylized model shows that, compared to the non-strategic environment, content creator competition shifts the platform's optimal policy toward weaker regularization, thereby favoring lower bias in the bias-variance tradeoff. To validate and assess the robustness of these insights beyond the stylized setting, we conduct extensive experiments on both synthetic and real-world benchmark datasets. The empirical results consistently support our theoretical conclusion: in strategic environments, reducing bias leads to higher user welfare. These findings offer practical implications for the design of real-world recommendation algorithms in the presence of content creator competition.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1618575e-2bbd-4af8-958c-cc342bf917dcBuilds on13
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Performative PredictionJuan C. Perdomo, Tijana Zrnic, Celestine Mendler-Dünner, Moritz HardtICML 2020 · 422 citations
- Rethinking Bias-Variance Trade-off for Generalization of Neural NetworksZitong Yang, Yaodong Yu, Chong You, Jacob Steinhardt et al.ICML 2020 · 219 citations
- Supply-Side Equilibria in Recommender SystemsMeena Jagadeesan, Nikhil Garg, Jacob SteinhardtNeurIPS 2023 · 53 citations
- How Bad is Top-K Recommendation under Competing Content Creators?Fan Yao, Chuanhao Li, Denis Nekipelov, Hongning Wang et al.ICML 2023 · 39 citations
Related papers
- User Welfare Optimization in Recommender Systems with Competing Content CreatorsFan Yao, Yiming Liao, Mingzhe Wu, Chuanhao Li et al.KDD 2024 · 5 citations
- Clickbait vs. Quality: How Engagement-Based Optimization Shapes the Content Landscape in Online PlatformsNicole Immorlica, Meena Jagadeesan, Brendan LucierWWW 2024 · 26 citations
- Unveiling User Satisfaction and Creator Productivity Trade-Offs in Recommendation PlatformsFan Yao, Yiming Liao, Jingzhou Liu, Shaoliang Nie et al.NeurIPS 2024 · 19 citations
- Beyond Self-Interest: How Group Strategies Reshape Content Creation in Recommendation Platforms?Yaolong Yu, Fan Yao, Sinno Jialin PanICML 2025
- Modeling content creator incentives on algorithm-curated platformsJiri Hron, Karl Krauth, Michael I. Jordan, Niki Kilbertus et al.ICLR 2023 · 5 citations
