Comparator-Adaptive Φ-Regret: Improved Bounds, Simpler Algorithms, and Applications to Games
Soumita Hait, Ping Li, Haipeng Luo, Mengxiao Zhang
摘要
In the classic expert problem, -regret measures the gap between the learner's total loss and that achieved by applying the best action transformation . A recent work by Lu et al., [2025] introduces an adaptive algorithm whose regret against a comparator depends on a certain sparsity-based complexity measure of , (almost) recovering and interpolating optimal bounds for standard regret notions such as external, internal, and swap regret. In this work, we propose a general idea to achieve an even better comparator-adaptive -regret bound via much simpler algorithms compared to Lu et al., [2025]. Specifically, we discover a prior distribution over all possible binary transformations and show that it suffices to achieve prior-dependent regret against these transformations. Then, we propose two concrete and efficient algorithms to achieve so, where the first one learns over multiple copies of a prior-aware variant of the Kernelized MWU algorithm of Farina et al., [2022], and the second one learns over multiple copies of a prior-aware variant of the BM-reduction [Blum and Mansour, 2007]. To further showcase the power of our methods and the advantages over Lu et al., [2025] besides the simplicity and better regret bounds, we also show that our second approach can be extended to the game setting to achieve accelerated and adaptive convergence rate to -equilibria for a class of general-sum games. When specified to the special case of correlated equilibria, our bound improves over the existing ones from Anagnostides et al., [2022a,b]
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper15
- Near-Optimal No-Regret Learning in General GamesConstantinos Daskalakis, Maxwell Fishelson, Noah GolowichNeurIPS 2021 · 被引用 141 次
- No-Regret Learning in Time-Varying Zero-Sum GamesMengxiao Zhang, Peng Zhao, Haipeng Luo, Zhi-Hua ZhouICML 2022 · 被引用 59 次
- On Last-Iterate Convergence Beyond Zero-Sum GamesIoannis Anagnostides, Ioannis Panageas, Gabriele Farina, Tuomas SandholmICML 2022 · 被引用 52 次
- Uncoupled Learning Dynamics with O(log T) Swap Regret in Multiplayer GamesIoannis Anagnostides, Gabriele Farina, Christian Kroer, Chung-Wei Lee 等NeurIPS 2022 · 被引用 51 次
- Near-Optimal No-Regret Learning Dynamics for General Convex GamesGabriele Farina, Ioannis Anagnostides, Haipeng Luo, Chung-Wei Lee 等NeurIPS 2022 · 被引用 43 次
相关 Paper
- From External to Swap Regret 2.0: An Efficient Reduction for Large Action SpacesYuval Dagan, Constantinos Daskalakis, Maxwell Fishelson, Noah GolowichSTOC 2024 · 被引用 2 次
- Efficient Learning and Computation of Linear Correlated Equilibrium in General Convex GamesConstantinos Daskalakis, Gabriele Farina, Maxwell Fishelson, Charilaos Pipis 等STOC 2025 · 被引用 14 次
- Optimal Comparator Adaptive Online Learning with Switching CostZhiyu Zhang, Ashok Cutkosky, Yannis PaschalidisNeurIPS 2022 · 被引用 10 次
- Is Learning in Games Good for the Learners?William Brown, Jon Schneider, Kiran VodrahalliNeurIPS 2023 · 被引用 27 次
- Efficient Phi-Regret Minimization in Extensive-Form Games via Online Mirror DescentYu Bai, Chi Jin, Song Mei, Ziang Song 等NeurIPS 2022 · 被引用 24 次
