Asymmetric Perturbation in Solving Bilinear Saddle-Point Optimization
Kenshi Abe, Mitsuki Sakamoto, Kaito Ariu, Atsushi Iwasaki
Abstract
This paper proposes an asymmetric perturbation technique for solving bilinear saddle-point optimization problems, commonly arising in minimax problems, game theory, and constrained optimization. Perturbing payoffs or values is known to be effective in stabilizing learning dynamics and equilibrium computation. However, it requires decreasing perturbation magnitudes to ensure convergence to an equilibrium in the underlying game, resulting in a slower rate. To overcome this, we introduce an asymmetric perturbation approach, where only one player's payoff function is perturbed. Exploiting the near-linear structure of bilinear problems, we show that, for a sufficiently small perturbation, the equilibrium strategy of the asymmetrically perturbed game coincides with an equilibrium strategy of the original game. Building on this property, we develop a perturbation-based learning algorithm with a linear last-iterate convergence rate to an equilibrium strategy of the original game, and we further show how to construct a parameter-free procedure that retains a linear rate. Finally, we empirically demonstrate fast convergence toward equilibria in both normal-form and extensive-form games.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext e0adcf44-7941-4c1f-8acb-a889ef162388Builds on12
- Linear Last-iterate Convergence in Constrained Saddle-point OptimizationChen-Yu Wei, Chung-Wei Lee, Mengxiao Zhang, Haipeng LuoICLR 2021 · 146 citations
- Fast Policy Extragradient Methods for Competitive Games with Entropy RegularizationShicong Cen, Yuting Wei, Yuejie ChiNeurIPS 2021 · 105 citations
- From Poincaré Recurrence to Convergence in Imperfect Information Games: Finding Equilibrium via RegularizationJulien Pérolat, Rémi Munos, Jean-Baptiste Lespiau, Shayegan Omidshafiei et al.ICML 2021 · 102 citations
- Online Iterative Reinforcement Learning from Human Feedback with General Preference ModelChenlu Ye, Wei Xiong, Yuheng Zhang, Hanze Dong et al.NeurIPS 2024 · 60 citations
- Last-iterate Convergence in Extensive-Form GamesChung-Wei Lee, Christian Kroer, Haipeng LuoNeurIPS 2021 · 57 citations
Related papers
- Boosting Perturbed Gradient Ascent for Last-Iterate Convergence in GamesKenshi Abe, Mitsuki Sakamoto, Kaito Ariu, Atsushi IwasakiICLR 2025
- Adaptively Perturbed Mirror Descent for Learning in GamesKenshi Abe, Kaito Ariu, Mitsuki Sakamoto, Atsushi IwasakiICML 2024 · 10 citations
- Classic but Everlasting: Traditional Gradient-Based Algorithms Converge Fast Even in Time-Varying Multi-Player GamesYanzheng Chen, Jun YuICLR 2025
- Solving Matrix Games with Near-Optimal Matvec ComplexityIshani Karmarkar, Liam O'Carroll, Aaron SidfordSTOC 2026 · 4 citations
- Memory Asymmetry Creates Heteroclinic Orbits to Nash Equilibrium in Learning in Zero-Sum GamesYuma Fujimoto, Kaito Ariu, Kenshi AbeAAAI 2024 · 2 citations
