Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter Updates
Sanghoon Yu, Min-hwan Oh
Abstract
We study linear contextual bandits under rare parameter updates: the learner may incorporate reward feedback into its parameter estimate only at a small number of update times, while still observing contexts online and selecting actions sequentially. This viewpoint clarifies a practical distinction that is often blurred in the literature: many "strictly batched" methods additionally restrict within-interval context adaptivity, meaning that the action rule inside an interval cannot depend on the sequence of realized contexts/actions in that interval (beyond the current round's context). For linear contextual bandits, we propose two practical algorithms with only O(log log T ) parameter updates. Our first algorithm BLCE-G attains minimax-optimal regret (up to polylogarithmic factors in T ) simultaneously in both the small-K and large-K regimes under a static schedule. Our second algorithm BLCE removes the near Goptimal design step-a dominant computational bottleneck in prior strictly batched static-grid methods-yet preserves minimax-optimal regret and achieves the lowest known runtime complexity among optimal algorithms. We further extend these rare-update and computational principles to generalized linear contextual bandits. Overall, our results yield minimax-optimal algorithms for linear contextual bandits and a near-optimal generalized-linear extension under O(log log T ) parameter updates, while remaining computationally efficient in practice.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 23115078-8d91-4e53-8b52-2099dc38889dCited by top-tier papers1
Ask how each one uses itBuilds on9
- Regret Bounds for Batched BanditsHossein Esfandiari, Amin Karbasi, Abbas Mehrabian, Vahab S. MirrokniAAAI 2021 · 74 citations
- Parallelizing Thompson SamplingAmin Karbasi, Vahab S. Mirrokni, Mohammad ShadravanNeurIPS 2021 · 32 citations
- Almost Optimal Anytime Algorithm for Batched Multi-Armed BanditsTianyuan Jin, Jing Tang, Pan Xu, Keke Huang et al.ICML 2021 · 25 citations
- Generalized Linear Bandits with Limited AdaptivityAyush Sawarni, Nirjhar Das, Siddharth Barman, Gaurav SinhaNeurIPS 2024 · 23 citations
- Linear bandits with limited adaptivity and learning distributional optimal designYufei Ruan, Jiaqi Yang, Yuan ZhouSTOC 2021 · 19 citations
Related papers
- Optimal and Practical Batched Linear Bandit AlgorithmSanghoon Yu, Min-hwan OhICML 2025
- Optimal Batched Linear BanditsXuanfei Ren, Tianyuan Jin, Pan XuICML 2024 · 6 citations
- Infrequent Exploration in Linear BanditsHarin Lee, Min-hwan OhNeurIPS 2025
- An Asymptotically Optimal Primal-Dual Incremental Algorithm for Contextual Linear BanditsAndrea Tirinzoni, Matteo Pirotta, Marcello Restelli, Alessandro LazaricNeurIPS 2020 · 37 citations
- Breaking the Barrier: Instance-Independent Logarithmic Regret in Stochastic Contextual Linear BanditsAvishek Ghosh, Abishek SankararamanICML 2022 · 5 citations
