Tighter Regret Lower Bound for Gaussian Process Bandits with Squared Exponential Kernel in Hypersphere
Shogo Iwazaki
Abstract
We study an algorithm-independent, worst-case lower bound for the Gaussian process (GP) bandit problem in the frequentist setting, where the reward function is fixed and has a bounded norm in the known reproducing kernel Hilbert space (RKHS). Specifically, we focus on the squared exponential (SE) kernel, one of the most widely used kernel functions in GP bandits. One of the remaining open questions for this problem is the gap in the dimension-dependent logarithmic factors between upper and lower bounds. This paper partially resolves this open question under a hyperspherical input domain. We show that any algorithm suffers cumulative regret, where and represent the total number of steps and the dimension of the hyperspherical domain, respectively. Regarding the simple regret, we show that any algorithm requires time steps to find an -optimal point. We also provide the improved upper bound on the maximum information gain for the SE kernel. Our results guarantee the optimality of the existing best algorithm up to dimension-independent logarithmic factors under a hyperspherical input domain.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Neural Contextual Bandits with UCB-based ExplorationDongruo Zhou, Lihong Li, Quanquan GuICML 2020 · 329 citations
- Vanilla Bayesian Optimization Performs Great in High DimensionsCarl Hvarfner, Erik Orm Hellsten, Luigi NardiICML 2024 · 88 citations
- Optimal Order Simple Regret for Gaussian Process BanditsSattar Vakili, Nacime Bouziani, Sepehr Jalali, Alberto Bernacchia et al.NeurIPS 2021 · 70 citations
- High-dimensional Experimental Design and Kernel BanditsRomain Camilleri, Kevin Jamieson, Julian Katz-SamuelsICML 2021 · 63 citations
- A Domain-Shrinking based Bayesian Optimization Algorithm with Order-Optimal Regret PerformanceSudeep Salgia, Sattar Vakili, Qing ZhaoNeurIPS 2021 · 49 citations
Related papers
- Gaussian Process Upper Confidence Bound Achieves Nearly-Optimal Regret in Noise-Free Gaussian Process BanditsShogo IwazakiNeurIPS 2025 · 10 citations
- On Lower Bounds for Standard and Robust Gaussian Process Bandit OptimizationXu Cai, Jonathan ScarlettICML 2021 · 32 citations
- Instance Dependent Regret Analysis of Kernelized BanditsShubhanshu Shekhar, Tara JavidiICML 2022 · 4 citations
- A Robust Phased Elimination Algorithm for Corruption-Tolerant Gaussian Process BanditsIlija Bogunovic, Zihan Li, Andreas Krause, Jonathan ScarlettNeurIPS 2022 · 13 citations
- On the Sublinear Regret of GP-UCBJustin Whitehouse, Aaditya Ramdas, Zhiwei Steven WuNeurIPS 2023 · 35 citations
