Is Knowledge Power? On the (Im)possibility of Learning from Strategic Interactions
Nivasini Ananthakrishnan, Nika Haghtalab, Chara Podimata, Kunhe Yang
Abstract
When learning in strategic environments, a key question is whether agents can overcome uncertainty about their preferences to achieve outcomes they could have achieved absent any uncertainty. Can they do this solely through interactions with each other? We focus this question on the ability of agents to attain the value of their Stackelberg optimal strategy and study the impact of information asymmetry. We study repeated interactions in fully strategic environments where players' actions are decided based on learning algorithms that take into account their observed histories and knowledge of the game. We study the pure Nash equilibria (PNE) of a meta-game where players choose these algorithms as their actions. We demonstrate that if one player has perfect knowledge about the game, then any initial informational gap persists. That is, while there is always a PNE in which the informed agent achieves her Stackelberg value, there is a game where no PNE of the meta-game allows the partially informed player to achieve her Stackelberg value. On the other hand, if both players start with some uncertainty about the game, the quality of information alone does not determine which agent can achieve her Stackelberg value. In this case, the concept of information asymmetry becomes nuanced and depends on the game's structure. Overall, our findings suggest that repeated strategic interactions alone cannot facilitate learning effectively enough to earn an uninformed player her Stackelberg value.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext cf0b8627-5a2e-408d-aa23-de6f02070ef1Builds on12
- Implicit Learning Dynamics in Stackelberg Games: Equilibria Characterization, Convergence Analysis, and Empirical StudyTanner Fiez, Benjamin Chasnov, Lillian J. RatliffICML 2020 · 144 citations
- Who Leads and Who Follows in Strategic Classification?Tijana Zrnic, Eric Mazumdar, S. Shankar Sastry, Michael I. JordanNeurIPS 2021 · 76 citations
- Contracting with a Learning AgentGuru Guruganesh, Yoav Kolumbus, Jon Schneider, Inbal Talgam-Cohen et al.NeurIPS 2024 · 38 citations
- Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated AgentsNika Haghtalab, Chara Podimata, Kunhe YangNeurIPS 2023 · 34 citations
- How and Why to Manipulate Your Own Agent: On the Incentives of Users of Learning AgentsYoav Kolumbus, Noam NisanNeurIPS 2022 · 28 citations
Related papers
- Learning to Steer Learners in GamesYizhou Zhang, Yian Ma, Eric MazumdarICML 2025
- Is Learning in Games Good for the Learners?William Brown, Jon Schneider, Kiran VodrahalliNeurIPS 2023 · 27 citations
- Sample-Efficient Learning of Stackelberg Equilibria in General-Sum GamesYu Bai, Chi Jin, Huan Wang, Caiming XiongNeurIPS 2021 · 81 citations
- Interactive Inverse Reinforcement Learning for Cooperative GamesThomas Kleine Büning, Anne-Marie George, Christos DimitrakakisICML 2022 · 7 citations
- Learning Strategy-Aware Linear ClassifiersYiling Chen, Yang Liu, Chara PodimataNeurIPS 2020 · 110 citations
