Theoretical Guarantees for the Retention of Strict Nash Equilibria by Coevolutionary Algorithms
Alistair Benford, Per Kristian Lehre
Abstract
Most methods for finding a Nash equilibrium rely on procedures that operate over the entire action space, making them infeasible for settings with too many actions to be searched exhaustively. Randomised search heuristics such as coevolutionary algorithms offer benefits in such settings, however they lack many of the theoretical guarantees established for exhaustive methods such as zero-regret learning. We address this by developing a method for proving necessary and sufficient conditions for a coevolutionary algorithm to be stable, in the sense that it reliably retains a Nash equilibrium following discovery. As the method provides bounds that are adapted to both application and algorithm instance, it can be used as a practical tool for parameter configuration. We additionally show how bounds on regret may be deduced from our results and undertake corresponding empirical analysis.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext bec34fae-31f3-45f5-807f-9488bc5c95d1Builds on4
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 205 citations
- Convergence of Gradient Methods on Bilinear Zero-Sum GamesGuojun Zhang, Yaoliang YuICLR 2020 · 37 citations
- Understanding and Stabilizing GANs' Training Dynamics Using Control TheoryKun Xu, Chongxuan Li, Jun Zhu, Bo ZhangICML 2020 · 31 citations
- Towards Runtime Analysis of Population-Based Co-evolutionary Algorithms on Sparse Binary Zero-Sum GamePer Kristian Lehre, Shishen LinAAAI 2025 · 3 citations
Related papers
- No-Regret Learning and Mixed Nash Equilibria: They Do Not MixEmmanouil V. Vlatakis-Gkaragkounis, Lampros Flokas, Thanasis Lianeas, Panayotis Mertikopoulos et al.NeurIPS 2020 · 100 citations
- Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum GamesStratis Skoulakis, Tanner Fiez, Ryann Sim, Georgios Piliouras et al.AAAI 2021 · 17 citations
- Sampling Equilibria: Fast No-Regret Learning in Structured GamesDaniel Beaglehole, Max Hopkins, Daniel Kane, Sihan Liu et al.SODA 2023 · 2 citations
- Convergence of No-Swap-Regret Dynamics in Self-PlayRenato Paes Leme, Georgios Piliouras, Jon SchneiderNeurIPS 2024 · 3 citations
- Specification-Guided Learning of Nash Equilibria with High Social WelfareKishor Jothimurugan, Suguman Bansal, Osbert Bastani, Rajeev AlurCAV 2022 · 9 citations
