Asymmetric Perturbation in Solving Bilinear Saddle-Point Optimization
Kenshi Abe, Mitsuki Sakamoto, Kaito Ariu, Atsushi Iwasaki
摘要
This paper proposes an asymmetric perturbation technique for solving bilinear saddle-point optimization problems, commonly arising in minimax problems, game theory, and constrained optimization. Perturbing payoffs or values is known to be effective in stabilizing learning dynamics and equilibrium computation. However, it requires decreasing perturbation magnitudes to ensure convergence to an equilibrium in the underlying game, resulting in a slower rate. To overcome this, we introduce an asymmetric perturbation approach, where only one player's payoff function is perturbed. Exploiting the near-linear structure of bilinear problems, we show that, for a sufficiently small perturbation, the equilibrium strategy of the asymmetrically perturbed game coincides with an equilibrium strategy of the original game. Building on this property, we develop a perturbation-based learning algorithm with a linear last-iterate convergence rate to an equilibrium strategy of the original game, and we further show how to construct a parameter-free procedure that retains a linear rate. Finally, we empirically demonstrate fast convergence toward equilibria in both normal-form and extensive-form games.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper12
- Linear Last-iterate Convergence in Constrained Saddle-point OptimizationChen-Yu Wei, Chung-Wei Lee, Mengxiao Zhang, Haipeng LuoICLR 2021 · 被引用 146 次
- Fast Policy Extragradient Methods for Competitive Games with Entropy RegularizationShicong Cen, Yuting Wei, Yuejie ChiNeurIPS 2021 · 被引用 105 次
- From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via RegularizationJulien Pérolat, Rémi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei 等ICML 2021 · 被引用 102 次
- Online Iterative Reinforcement Learning from Human Feedback with General Preference ModelChenlu Ye, Wei Xiong, Yuheng Zhang, Hanze Dong 等NeurIPS 2024 · 被引用 60 次
- Last-iterate Convergence in Extensive-Form GamesChung-Wei Lee, Christian Kroer, Haipeng LuoNeurIPS 2021 · 被引用 57 次
相关 Paper
- Boosting Perturbed Gradient Ascent for Last-Iterate Convergence in GamesKenshi Abe, Mitsuki Sakamoto, Kaito Ariu, Atsushi IwasakiICLR 2025
- Adaptively Perturbed Mirror Descent for Learning in GamesKenshi Abe, Kaito Ariu, Mitsuki Sakamoto, Atsushi IwasakiICML 2024 · 被引用 10 次
- Classic but Everlasting: Traditional Gradient-Based Algorithms Converge Fast Even in Time-Varying Multi-Player GamesYanzheng Chen, Jun YuICLR 2025
- Solving Matrix Games with Near-Optimal Matvec ComplexityIshani Karmarkar, Liam O'Carroll, Aaron SidfordSTOC 2026 · 被引用 4 次
- Memory Asymmetry Creates Heteroclinic Orbits to Nash Equilibrium in Learning in Zero-Sum GamesYuma Fujimoto, Kaito Ariu, Kenshi AbeAAAI 2024 · 被引用 2 次
