Prediction-Aware Learning in Multi-Agent Systems
Aymeric Capitaine, Etienne Boursier, Eric Moulines, Michael I. Jordan, Alain Oliviero Durmus
Abstract
The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret bounds quickly become vacuous when the game undergoes significant variations over time, even when these variations are easy to predict. Intuitively, the ability of players to forecast future payoffs should lead to tighter guarantees, yet existing approaches fail to incorporate this aspect. This work aims to fill this gap by introducing a novel prediction-aware framework for time-varying games, where agents can forecast future payoffs and adapt their strategies accordingly. In this framework, payoffs depend on an underlying state of nature that agents predict in an online manner. To leverage these predictions, we propose the POMWU algorithm, a contextual extension of the optimistic Multiplicative Weight Update algorithm, for which we establish theoretical guarantees on social welfare and convergence to equilibrium. Our results demonstrate that, under bounded prediction errors, the proposed framework achieves performance comparable to the static setting. Finally, we empirically demonstrate the effectiveness of POMWU in a traffic routing experiment.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d64410ec-93ac-4bd2-8d81-96e532d909d7Builds on11
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 141 citations
- Hedging in games: Faster convergence of external and swap regretsXi Chen, Binghui PengNeurIPS 2020 · 88 citations
- Uncoupled Learning Dynamics with O(log T) Swap Regret in Multiplayer GamesIoannis Anagnostides, Gabriele Farina, Christian Kroer, Chung-Wei Lee et al.NeurIPS 2022 · 51 citations
- Beyond Time-Average Convergence: Near-Optimal Uncoupled Online Learning via Clairvoyant Multiplicative Weights UpdateGeorgios Piliouras, Ryann Sim, Stratis SkoulakisNeurIPS 2022 · 31 citations
- On the Convergence of No-Regret Learning Dynamics in Time-Varying GamesIoannis Anagnostides, Ioannis Panageas, Gabriele Farina, Tuomas SandholmNeurIPS 2023 · 27 citations
Related papers
- Faster Rates for No-Regret Learning in General Games via Cautious OptimismAshkan Soleymani, Georgios Piliouras, Gabriele FarinaSTOC 2025 · 1 citation
- Contextual Games: Multi-Agent Learning with Side InformationPier Giuseppe Sessa, Ilija Bogunovic, Andreas Krause, Maryam KamgarpourNeurIPS 2020 · 26 citations
- Learning from Delayed Feedback in Games via Extra PredictionYuma Fujimoto, Kenshi Abe, Kaito AriuNeurIPS 2025 · 1 citation
- Kernelized Multiplicative Weights for 0/1-Polyhedral Games: Bridging the Gap Between Learning in Extensive-Form and Normal-Form GamesGabriele Farina, Chung-Wei Lee, Haipeng Luo, Christian KroerICML 2022 · 35 citations
- Fast Rates in Time-Varying Strongly Monotone GamesYu-Hu Yan, Peng Zhao, Zhi-Hua ZhouICML 2023 · 12 citations
