A Geometric Decomposition of Finite Games: Convergence vs. Recurrence under Exponential Weights
Davide Legacci, Panayotis Mertikopoulos, Bary S. R. Pradelski
Abstract
In view of the complexity of the dynamics of learning in games, we seek to decompose a game into simpler components where the dynamics' long-run behavior is well understood. A natural starting point for this is Helmholtz's theorem, which decomposes a vector field into a potential and an incompressible component. However, the geometry of game dynamics - and, in particular, the dynamics of exponential / multiplicative weights (EW) schemes - is not compatible with the Euclidean underpinnings of Helmholtz's theorem. This leads us to consider a specific Riemannian framework based on the so-called Shahshahani metric, and introduce the class of incompressible games, for which we establish the following results: First, in addition to being volume-preserving, the continuous-time EW dynamics in incompressible games admit a constant of motion and are Poincaré recurrent - i.e., almost every trajectory of play comes arbitrarily close to its starting point infinitely often. Second, we establish a deep connection with a well-known decomposition of games into a potential and harmonic component (where the players' objectives are aligned and anti-aligned respectively): a game is incompressible if and only if it is harmonic, implying in turn that the EW dynamics lead to Poincaré recurrence in harmonic games.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b8fe80b0-e136-482f-b551-11f424a8bf29Cited by top-tier papers3
- No-regret Learning in Harmonic Games: Extrapolation in the Face of Conflicting InterestsDavide Legacci, Panayotis Mertikopoulos, Christos H. Papadimitriou, Georgios Piliouras et al.NeurIPS 2024 · 10 citations
- The impact of uncertainty on regularized learning in gamesPierre-Louis Cauvin, Davide Legacci, Panayotis MertikopoulosICML 2025
- What Preferences Can—and Cannot—Predict in Multi-Agent Online LearningOmar Abbadi, Rida Laraki, Panayotis MertikopoulosICML 2026
Builds on7
- Linear Last-iterate Convergence in Constrained Saddle-point OptimizationChen-Yu Wei, Chung-Wei Lee, Mengxiao Zhang, Haipeng LuoICLR 2021 · 146 citations
- No-Regret Learning and Mixed Nash Equilibria: They Do Not MixEmmanouil V. Vlatakis-Gkaragkounis, Lampros Flokas, Thanasis Lianeas, Panayotis Mertikopoulos et al.NeurIPS 2020 · 100 citations
- Explore Aggressively, Update Conservatively: Stochastic Extragradient Methods with Variable Stepsize ScalingYu-Guan Hsieh, Franck Iutzeler, Jérôme Malick, Panayotis MertikopoulosNeurIPS 2020 · 86 citations
- No-regret learning in games with noisy feedback: Faster rates and adaptivity via learning rate separationYu-Guan Hsieh, Kimon Antonakopoulos, Volkan Cevher, Panayotis MertikopoulosNeurIPS 2022 · 38 citations
- From Chaos to Order: Symmetry and Conservation Laws in Game DynamicsSai Ganesh Nagarajan, David Balduzzi, Georgios PiliourasICML 2020 · 20 citations
Related papers
- Chaos, Extremism and Optimism: Volume Analysis of Learning in GamesYun Kuen Cheung, Georgios PiliourasNeurIPS 2020 · 42 citations
- Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum GamesStratis Skoulakis, Tanner Fiez, Ryann Sim, Georgios Piliouras et al.AAAI 2021 · 17 citations
- Matrix Multiplicative Weights Updates in Quantum Zero-Sum Games: Conservation Laws & RecurrenceRahul Jain, Georgios Piliouras, Ryann SimNeurIPS 2022 · 11 citations
- Newton Optimization on Helmholtz Decomposition for Continuous GamesGiorgia Ramponi, Marcello RestelliAAAI 2021 · 5 citations
- Follow-the-Regularized-Leader Routes to Chaos in Routing GamesJakub Bielawski, Thiparat Chotibut, Fryderyk Falniowski, Grzegorz Kosiorowski et al.ICML 2021 · 29 citations
