Lune

NeurIPS2025Top-tier venue

High-Dimensional Calibration from Swap Regret

Maxwell Fishelson, Noah Golowich, Mehryar Mohri, Jon Schneider

2025Year
16Citations
1Top-tier citations

Abstract

We study online calibration of multi-dimensional forecasts over an arbitrary convex set P⊂RdP \subset \mathbb{R}^d relative to an arbitrary norm ∣⋅∣|\cdot|. We connect this to external regret minimization for online linear optimization (OLO): if one can guarantee O(ρT)O(\sqrt{\rho T}) worst-case regret after TT rounds when actions are drawn from PP and losses from the dual ∣⋅∣∗|\cdot|_* unit norm ball, then one can obtain ϵ\epsilon-calibrated forecasts after T=exp⁡(O~(ρ/ϵ2))T = \exp(\tilde O(\rho/\epsilon^2)) rounds. When PP is the dd-dimensional simplex and ∣⋅∣|\cdot| is the ℓ1\ell_1-norm, the O(Tlog⁡d)O(\sqrt{T\log d}) experts regret bound yields ϵ\epsilon-calibrated forecasts after T=exp⁡(O~(log⁡d/ϵ2))=dO~(1/ϵ2)T = \exp(\tilde O(\log d/\epsilon^2)) = d^{\tilde O(1/\epsilon^2)} rounds, recovering a recent result of Peng (2025). Interestingly, our algorithm obtains this guarantee without requiring access to any online linear optimization subroutine or knowledge of the optimal rate ρ\rho -- in fact, our algorithm is identical for every setting of PP and ∣⋅∣|\cdot|. Instead, we show that the optimal regularizer for the above OLO problem can be used to upper bound the above calibration error by a swap regret, which we then minimize by running the recent TreeSwap algorithm (Dagan et al., 2024; Peng and Rubinstein, 2024) with Follow-The-Leader as a subroutine. The resulting algorithm is highly efficient and plays a distribution over simple averages of past observations in each round. Finally, we prove that any online calibration algorithm that guarantees ϵT\epsilon T ℓ1\ell_1-calibration error over the dd-dimensional simplex requires T≥exp⁡(poly(1/ϵ))T \geq \exp(\mathrm{poly}(1/\epsilon)) (assuming d≥poly(1/ϵ)d \geq \mathrm{poly}(1/\epsilon)). This strengthens the corresponding dΩ(log⁡(1/ϵ))d^{\Omega(\log(1/\epsilon))} lower bound of Peng (2025), and shows that an exponential dependence on 1/ϵ1/\epsilon is necessary.

Ask about this paper

Your agent reads all of it.

Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.

Questions to start from

Your agent calls

Luneget_paper_fulltext

Ask in Lune

Free to start. No credit card required.

lune papers fulltext 186e53c1-6d0e-4db5-b4c2-556cb3f757c5

Cited by top-tier papers1

Ask how each one uses it

Builds on12

Related papers

Dusk over the sea between two cliffs drawn in fine vertical lines