Efficient Inverse Multiagent Learning
Denizalp Goktas, Amy Greenwald, Sadie Zhao, Alec Koppel, Sumitra Ganesh
Abstract
In this paper, we study inverse game theory (resp. inverse multiagent learning) in which the goal is to find parameters of a game's payoff functions for which the expected (resp. sampled) behavior is an equilibrium. We formulate these problems as generative-adversarial (i.e., min-max) optimization problems, which we develop polynomial-time algorithms to solve, the former of which relies on an exact firstorder oracle, and the latter, a stochastic one. We extend our approach to solve inverse multiagent simulacral learning in polynomial time and number of samples. In these problems, we seek a simulacrum, meaning parameters and an associated equilibrium that replicate the given observations in expectation. We find that our approach outperforms the widely-used ARIMA method in predicting prices in Spanish electricity markets based on time-series data. * Research conducted while the author was an intern at JP Morgan Chase & Co.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c10b18ea-07eb-49b8-8404-77307efb49abCited by top-tier papers1
Ask how each one uses itBuilds on8
- On Gradient Descent Ascent for Nonconvex-Concave Minimax ProblemsTianyi Lin, Chi Jin, Michael I. JordanICML 2020 · 587 citations
- Independent Policy Gradient Methods for Competitive Reinforcement LearningConstantinos Daskalakis, Dylan J. Foster, Noah GolowichNeurIPS 2020 · 200 citations
- Do Differentiable Simulators Give Better Policy Gradients?Hyung Ju Terry Suh, Max Simchowitz, Kaiqing Zhang, Russ TedrakeICML 2022 · 129 citations
- Of Moments and Matching: A Game-Theoretic Framework for Closing the Imitation GapGokul Swamy, Sanjiban Choudhury, J. Andrew Bagnell, Steven WuICML 2021 · 90 citations
- PODS: Policy Optimization via Differentiable SimulationMiguel Zamora, Momchil Peychev, Sehoon Ha, Martin T. Vechev et al.ICML 2021 · 65 citations
Related papers
- Optimal Rates for Feasible Payoff Set Estimation in GamesAnnalisa Barbara, Riccardo Poiani, Martino Bernasconi, Andrea CelliICML 2026 · 1 citation
- Learning Strategic Network Emergence GamesRakshit S. Trivedi, Hongyuan ZhaNeurIPS 2020 · 4 citations
- On Computation and Generalization of Generative Adversarial Imitation LearningMinshuo Chen, Yizhou Wang, Tianyi Liu, Zhuoran Yang et al.ICLR 2020 · 42 citations
- Generative Adversarial Equilibrium SolversDenizalp Goktas, David C. Parkes, Ian Gemp, Luke Marris et al.ICLR 2024 · 9 citations
- Inverse Game Theory for Stackelberg Games: the Blessing of Bounded RationalityJibang Wu, Weiran Shen, Fei Fang, Haifeng XuNeurIPS 2022 · 27 citations
