Minimax Adaptive Online Nonparametric Regression over Besov spaces
Paul Liautaud, Pierre Gaillard, Olivier Wintenberger
Abstract
We study online adversarial regression with convex losses against a rich class of continuous yet highly irregular prediction rules, modeled by Besov spaces with general parameters and smoothness . We introduce an adaptive wavelet-based algorithm that performs sequential prediction without prior knowledge of , and establish minimax-optimal regret bounds against any comparator in . We further design a locally adaptive extension capable of dynamically tracking spatially inhomogeneous smoothness. This adaptive mechanism adjusts the resolution of the predictions over both time and space, yielding refined regret bounds in terms of local regularity. Consequently, in heterogeneous environments, our adaptive guarantees can significantly surpass those obtained by standard global methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on3
- Unconstrained Dynamic Regret via Sparse CodingZhiyu Zhang, Ashok Cutkosky, Yannis PaschalidisNeurIPS 2023 · 14 citations
- Locally-Adaptive Nonparametric Online LearningIlja Kuzborskij, Nicolò Cesa-BianchiNeurIPS 2020 · 9 citations
- Near-optimal learning with average Hölder smoothnessGuy Kornowski, Steve Hanneke, Aryeh KontorovichNeurIPS 2023 · 6 citations
Related papers
- Adaptive Online Estimation of Piecewise Polynomial TrendsDheeraj Baby, Yu-Xiang WangNeurIPS 2020 · 13 citations
- An Equivalence Between Static and Dynamic Regret MinimizationAndrew Jacobsen, Francesco OrabonaNeurIPS 2024 · 9 citations
- Dynamic Regret of Convex and Smooth FunctionsPeng Zhao, Yu-Jie Zhang, Lijun Zhang, Zhi-Hua ZhouNeurIPS 2020 · 136 citations
- Precise Regret Bounds for Log-loss via a Truncated Bayesian AlgorithmChanglong Wu, Mohsen Heidari, Ananth Grama, Wojciech SzpankowskiNeurIPS 2022 · 12 citations
- Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble ApproachYu-Hu Yan, Peng Zhao, Zhi-Hua ZhouNeurIPS 2023 · 16 citations
