High-Dimensional Calibration from Swap Regret
Maxwell Fishelson, Noah Golowich, Mehryar Mohri, Jon Schneider
Abstract
We study online calibration of multi-dimensional forecasts over an arbitrary convex set relative to an arbitrary norm . We connect this to external regret minimization for online linear optimization (OLO): if one can guarantee worst-case regret after rounds when actions are drawn from and losses from the dual unit norm ball, then one can obtain -calibrated forecasts after rounds. When is the -dimensional simplex and is the -norm, the experts regret bound yields -calibrated forecasts after rounds, recovering a recent result of Peng (2025). Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate -- in fact, our algorithm is identical for every setting of and . Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm (Dagan et al., 2024; Peng and Rubinstein, 2024) with Follow-The-Leader as a subroutine. The resulting algorithm is highly efficient and plays a distribution over simple averages of past observations in each round. Finally, we prove that any online calibration algorithm that guarantees -calibration error over the -dimensional simplex requires (assuming ). This strengthens the corresponding lower bound of Peng (2025), and shows that an exponential dependence on is necessary.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 186e53c1-6d0e-4db5-b4c2-556cb3f757c5Cited by top-tier papers1
Ask how each one uses itBuilds on12
- Individual Calibration with Randomized ForecastingShengjia Zhao, Tengyu Ma, Stefano ErmonICML 2020 · 69 citations
- Optimal Multiclass U-Calibration Error and BeyondHaipeng Luo, Spandan Senapati, Vatsal SharanNeurIPS 2024 · 15 citations
- Simultaneous Swap Regret Minimization via KL-CalibrationHaipeng Luo, Spandan Senapati, Vatsal SharanNeurIPS 2025 · 13 citations
- A Unifying Theory of Distance from CalibrationJaroslaw Blasiok, Parikshit Gopalan, Lunjia Hu, Preetum NakkiranSTOC 2023 · 7 citations
- Oracle Efficient Online Multicalibration and OmnipredictionSumegha Garg, Christopher Jung, Omer Reingold, Aaron RothSODA 2024 · 6 citations
Related papers
- High-Dimensional Prediction for Sequential Decision MakingGeorgy Noarov, Ramya Ramalingam, Aaron Roth, Stephan XieICML 2025
- Improved and Oracle-Efficient Online ℓ1-MulticalibrationRohan Ghuge, Vidya Muthukumar, Sahil SinglaICML 2025
- Online Minimax Multiobjective Optimization: Multicalibeating and Other ApplicationsDaniel Lee, Georgy Noarov, Mallesh M. Pai, Aaron RothNeurIPS 2022 · 30 citations
- On the necessity of adaptive regularisation: Optimal anytime online learning on ℓp-ballsEmmeran Johnson, David Martínez-Rubio, Ciara Pike-Burke, Patrick RebeschiniNeurIPS 2025 · 1 citation
- Alternation makes the adversary weaker in two-player gamesVolkan Cevher, Ashok Cutkosky, Ali Kavis, Georgios Piliouras et al.NeurIPS 2023 · 8 citations
