Minimax Adaptive Online Nonparametric Regression over Besov spaces
Paul Liautaud, Pierre Gaillard, Olivier Wintenberger
摘要
We study online adversarial regression with convex losses against a rich class of continuous yet highly irregular prediction rules, modeled by Besov spaces with general parameters and smoothness . We introduce an adaptive wavelet-based algorithm that performs sequential prediction without prior knowledge of , and establish minimax-optimal regret bounds against any comparator in . We further design a locally adaptive extension capable of dynamically tracking spatially inhomogeneous smoothness. This adaptive mechanism adjusts the resolution of the predictions over both time and space, yielding refined regret bounds in terms of local regularity. Consequently, in heterogeneous environments, our adaptive guarantees can significantly surpass those obtained by standard global methods.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper3
- Unconstrained Dynamic Regret via Sparse CodingZhiyu Zhang, Ashok Cutkosky, Yannis PaschalidisNeurIPS 2023 · 被引用 14 次
- Locally-Adaptive Nonparametric Online LearningIlja Kuzborskij, Nicolò Cesa-BianchiNeurIPS 2020 · 被引用 9 次
- Near-optimal learning with average Hölder smoothnessGuy Kornowski, Steve Hanneke, Aryeh KontorovichNeurIPS 2023 · 被引用 6 次
相关 Paper
- Adaptive Online Estimation of Piecewise Polynomial TrendsDheeraj Baby, Yu-Xiang WangNeurIPS 2020 · 被引用 13 次
- An Equivalence Between Static and Dynamic Regret MinimizationAndrew Jacobsen, Francesco OrabonaNeurIPS 2024 · 被引用 9 次
- Dynamic Regret of Convex and Smooth FunctionsPeng Zhao, Yu-Jie Zhang, Lijun Zhang, Zhi-Hua ZhouNeurIPS 2020 · 被引用 136 次
- Precise Regret Bounds for Log-loss via a Truncated Bayesian AlgorithmChanglong Wu, Mohsen Heidari, Ananth Grama, Wojciech SzpankowskiNeurIPS 2022 · 被引用 12 次
- Universal Online Learning with Gradient Variations: A Multi-layer Online Ensemble ApproachYu-Hu Yan, Peng Zhao, Zhi-Hua ZhouNeurIPS 2023 · 被引用 16 次
