Theoretical Guarantees for the Retention of Strict Nash Equilibria by Coevolutionary Algorithms
Alistair Benford, Per Kristian Lehre
摘要
Most methods for finding a Nash equilibrium rely on procedures that operate over the entire action space, making them infeasible for settings with too many actions to be searched exhaustively. Randomised search heuristics such as coevolutionary algorithms offer benefits in such settings, however they lack many of the theoretical guarantees established for exhaustive methods such as zero-regret learning. We address this by developing a method for proving necessary and sufficient conditions for a coevolutionary algorithm to be stable, in the sense that it reliably retains a Nash equilibrium following discovery. As the method provides bounds that are adapted to both application and algorithm instance, it can be used as a practical tool for parameter configuration. We additionally show how bounds on regret may be deduced from our results and undertake corresponding empirical analysis.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Combining Deep Reinforcement Learning and Search for Imperfect-Information GamesNoam Brown, Anton Bakhtin, Adam Lerer, Qucheng GongNeurIPS 2020 · 被引用 205 次
- Convergence of Gradient Methods on Bilinear Zero-Sum GamesGuojun Zhang, Yaoliang YuICLR 2020 · 被引用 37 次
- Understanding and Stabilizing GANs' Training Dynamics Using Control TheoryKun Xu, Chongxuan Li, Jun Zhu, Bo ZhangICML 2020 · 被引用 31 次
- Towards Runtime Analysis of Population-Based Co-evolutionary Algorithms on Sparse Binary Zero-Sum GamePer Kristian Lehre, Shishen LinAAAI 2025 · 被引用 3 次
相关 Paper
- No-Regret Learning and Mixed Nash Equilibria: They Do Not MixEmmanouil V. Vlatakis-Gkaragkounis, Lampros Flokas, Thanasis Lianeas, Panayotis Mertikopoulos 等NeurIPS 2020 · 被引用 100 次
- Evolutionary Game Theory Squared: Evolving Agents in Endogenously Evolving Zero-Sum GamesStratis Skoulakis, Tanner Fiez, Ryann Sim, Georgios Piliouras 等AAAI 2021 · 被引用 17 次
- Sampling Equilibria: Fast No-Regret Learning in Structured GamesDaniel Beaglehole, Max Hopkins, Daniel Kane, Sihan Liu 等SODA 2023 · 被引用 2 次
- Convergence of No-Swap-Regret Dynamics in Self-PlayRenato Paes Leme, Georgios Piliouras, Jon SchneiderNeurIPS 2024 · 被引用 3 次
- Specification-Guided Learning of Nash Equilibria with High Social WelfareKishor Jothimurugan, Suguman Bansal, Osbert Bastani, Rajeev AlurCAV 2022 · 被引用 9 次
