Generalized Linear Bandits with Memory
Heesang Ann, Hyun-jun Choi, Taehyun Hwang, Younghoon Shin, Haeju Cheong, Min-hwan Oh
Abstract
We study generalized linear bandits with memory, an endogenous non-stationary setting in which rewards depend on past actions through a finite memory matrix. Building on prior work for linear models Clerici et al.,(2024), we show that the previously known regret bound stems from a loose analysis, and we provide a sharpened analysis that recovers a regret rate in the linear case. We then extend this improvement to generalized linear models and propose a block-wise algorithm based on shrunken confidence bounds. Our algorithm achieves a regret bound of , where denotes the feature dimension, the memory length, and a curvature parameter of the link function. This attains a -type rate despite nonlinear rewards and memory effects. To the best of our knowledge, this analysis provides a unified treatment of memory-induced non-stationarity and nonlinear link functions, while ensuring that the leading regret term is independent of the curvature of the link function. We conduct numerical experiments that are consistent with our theoretical findings.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 81f1f2e0-fb88-4d83-9508-1f72139dabd2Builds on11
- Improved Optimistic Algorithms for Logistic BanditsLouis Faury, Marc Abeille, Clément Calauzènes, Olivier FercoqICML 2020 · 127 citations
- A Unified Confidence Sequence for Generalized Linear Models, with Applications to BanditsJunghyun Lee, Se-Young Yun, Kwang-Sung JunNeurIPS 2024 · 35 citations
- Online (Multinomial) Logistic Bandit: Improved Regret and Constant Computation CostYu-Jie Zhang, Masashi SugiyamaNeurIPS 2023 · 34 citations
- Rebounding Bandits for Modeling Satiation EffectsLiu Leqi, Fatma Kilinç-Karzan, Zachary C. Lipton, Alan L. MontgomeryNeurIPS 2021 · 30 citations
- Generalized Linear Bandits with Limited AdaptivityAyush Sawarni, Nirjhar Das, Siddharth Barman, Gaurav SinhaNeurIPS 2024 · 23 citations
Related papers
- Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed RewardsBo Xue, Yimu Wang, Yuanyu Wan, Jinfeng Yi et al.NeurIPS 2023 · 16 citations
- Double Doubly Robust Thompson Sampling for Generalized Linear Contextual BanditsWonyoung Kim, Kyungbok Lee, Myunghee Cho PaikAAAI 2023 · 19 citations
- Efficient Frameworks for Generalized Low-Rank Matrix Bandit ProblemsYue Kang, Cho-Jui Hsieh, Thomas Chun Man LeeNeurIPS 2022 · 24 citations
- Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward FunctionsYue Kang, Mingshuo Liu, Bongsoo Yi, Jing Lyu et al.ICLR 2026 · 7 citations
- Stochastic Bandits with Graph Feedback in Non-Stationary EnvironmentsShiyin Lu, Yao Hu, Lijun ZhangAAAI 2021 · 10 citations
