Generalized Linear Bandits with Memory
Heesang Ann, Hyun-jun Choi, Taehyun Hwang, Younghoon Shin, Haeju Cheong, Min-hwan Oh
摘要
We study generalized linear bandits with memory, an endogenous non-stationary setting in which rewards depend on past actions through a finite memory matrix. Building on prior work for linear models Clerici et al.,(2024), we show that the previously known regret bound stems from a loose analysis, and we provide a sharpened analysis that recovers a regret rate in the linear case. We then extend this improvement to generalized linear models and propose a block-wise algorithm based on shrunken confidence bounds. Our algorithm achieves a regret bound of , where denotes the feature dimension, the memory length, and a curvature parameter of the link function. This attains a -type rate despite nonlinear rewards and memory effects. To the best of our knowledge, this analysis provides a unified treatment of memory-induced non-stationarity and nonlinear link functions, while ensuring that the leading regret term is independent of the curvature of the link function. We conduct numerical experiments that are consistent with our theoretical findings.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper11
- Improved Optimistic Algorithms for Logistic BanditsLouis Faury, Marc Abeille, Clément Calauzènes, Olivier FercoqICML 2020 · 被引用 127 次
- A Unified Confidence Sequence for Generalized Linear Models, with Applications to BanditsJunghyun Lee, Se-Young Yun, Kwang-Sung JunNeurIPS 2024 · 被引用 35 次
- Online (Multinomial) Logistic Bandit: Improved Regret and Constant Computation CostYu-Jie Zhang, Masashi SugiyamaNeurIPS 2023 · 被引用 34 次
- Rebounding Bandits for Modeling Satiation EffectsLiu Leqi, Fatma Kilinç-Karzan, Zachary C. Lipton, Alan L. MontgomeryNeurIPS 2021 · 被引用 30 次
- Generalized Linear Bandits with Limited AdaptivityAyush Sawarni, Nirjhar Das, Siddharth Barman, Gaurav SinhaNeurIPS 2024 · 被引用 23 次
相关 Paper
- Efficient Algorithms for Generalized Linear Bandits with Heavy-tailed RewardsBo Xue, Yimu Wang, Yuanyu Wan, Jinfeng Yi 等NeurIPS 2023 · 被引用 16 次
- Double Doubly Robust Thompson Sampling for Generalized Linear Contextual BanditsWonyoung Kim, Kyungbok Lee, Myunghee Cho PaikAAAI 2023 · 被引用 19 次
- Efficient Frameworks for Generalized Low-Rank Matrix Bandit ProblemsYue Kang, Cho-Jui Hsieh, Thomas Chun Man LeeNeurIPS 2022 · 被引用 24 次
- Single Index Bandits: Generalized Linear Contextual Bandits with Unknown Reward FunctionsYue Kang, Mingshuo Liu, Bongsoo Yi, Jing Lyu 等ICLR 2026 · 被引用 7 次
- Stochastic Bandits with Graph Feedback in Non-Stationary EnvironmentsShiyin Lu, Yao Hu, Lijun ZhangAAAI 2021 · 被引用 10 次
