Is Knowledge Power? On the (Im)possibility of Learning from Strategic Interactions
Nivasini Ananthakrishnan, Nika Haghtalab, Chara Podimata, Kunhe Yang
摘要
When learning in strategic environments, a key question is whether agents can overcome uncertainty about their preferences to achieve outcomes they could have achieved absent any uncertainty. Can they do this solely through interactions with each other? We focus this question on the ability of agents to attain the value of their Stackelberg optimal strategy and study the impact of information asymmetry. We study repeated interactions in fully strategic environments where players' actions are decided based on learning algorithms that take into account their observed histories and knowledge of the game. We study the pure Nash equilibria (PNE) of a meta-game where players choose these algorithms as their actions. We demonstrate that if one player has perfect knowledge about the game, then any initial informational gap persists. That is, while there is always a PNE in which the informed agent achieves her Stackelberg value, there is a game where no PNE of the meta-game allows the partially informed player to achieve her Stackelberg value. On the other hand, if both players start with some uncertainty about the game, the quality of information alone does not determine which agent can achieve her Stackelberg value. In this case, the concept of information asymmetry becomes nuanced and depends on the game's structure. Overall, our findings suggest that repeated strategic interactions alone cannot facilitate learning effectively enough to earn an uninformed player her Stackelberg value.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Implicit Learning Dynamics in Stackelberg Games: Equilibria Characterization, Convergence Analysis, and Empirical StudyTanner Fiez, Benjamin Chasnov, Lillian J. RatliffICML 2020 · 被引用 144 次
- Who Leads and Who Follows in Strategic Classification?Tijana Zrnic, Eric Mazumdar, S. Shankar Sastry, Michael I. JordanNeurIPS 2021 · 被引用 76 次
- Contracting with a Learning AgentGuru Guruganesh, Yoav Kolumbus, Jon Schneider, Inbal Talgam-Cohen 等NeurIPS 2024 · 被引用 38 次
- Calibrated Stackelberg Games: Learning Optimal Commitments Against Calibrated AgentsNika Haghtalab, Chara Podimata, Kunhe YangNeurIPS 2023 · 被引用 34 次
- How and Why to Manipulate Your Own Agent: On the Incentives of Users of Learning AgentsYoav Kolumbus, Noam NisanNeurIPS 2022 · 被引用 28 次
相关 Paper
- Learning to Steer Learners in GamesYizhou Zhang, Yian Ma, Eric MazumdarICML 2025
- Is Learning in Games Good for the Learners?William Brown, Jon Schneider, Kiran VodrahalliNeurIPS 2023 · 被引用 27 次
- Sample-Efficient Learning of Stackelberg Equilibria in General-Sum GamesYu Bai, Chi Jin, Huan Wang, Caiming XiongNeurIPS 2021 · 被引用 81 次
- Interactive Inverse Reinforcement Learning for Cooperative GamesThomas Kleine Büning, Anne-Marie George, Christos DimitrakakisICML 2022 · 被引用 7 次
- Learning Strategy-Aware Linear ClassifiersYiling Chen, Yang Liu, Chara PodimataNeurIPS 2020 · 被引用 110 次
