Contextual Slate GLM Bandits with Limited Adaptivity
Tanmay Goyal, Sukruta Midigeshi, Gaurav Sinha
摘要
We investigate the contextual slate bandit problem with generalized linear rewards under limited adaptivity. At each round, the learner is presented with sets of items, where each item is represented by a -dimensional feature vector. The learner then constructs a slate by selecting one item per set; the resulting slate yields a scalar reward sampled from a Generalized Linear Model (GLM). We propose algorithms under two limited-adaptivity settings: (a) Batched and (b) Rarely-Switching. For the batched setting, we introduce B-SlateGLinCB, which partitions the time horizon into batches such that each batch's policy relies only on data from previous batches. For the rarely-switching setting, we propose RS-SlateGLinCB, which adaptively performs only parameter updates. Under a diversity assumption on the item sequences, we prove that B-SlateGLinCB and RS-SlateGLinCB achieve regret bounds of and , respectively. Notably, both bounds are independent of the non-linearity parameter that is typically found to scale the regret of GLM bandit algorithms. Our algorithms are computationally efficient, requiring only time per round despite possible slates. Simulations show our algorithms outperform existing baselines with limited adaptivity and remain competitive with Slate-GLM-OFU, a fully adaptive state-of-the-art algorithm. Notably, a slightly modified B-SlateGLinCB empirically matches this baseline. Finally, we demonstrate strong performance in a practical in-context example selection task for language models.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper8
- Improved Optimistic Algorithms for Logistic BanditsLouis Faury, Marc Abeille, Clément Calauzènes, Olivier FercoqICML 2020 · 被引用 127 次
- Leveraging Good Representations in Linear Contextual BanditsMatteo Papini, Andrea Tirinzoni, Marcello Restelli, Alessandro Lazaric 等ICML 2021 · 被引用 35 次
- Online (Multinomial) Logistic Bandit: Improved Regret and Constant Computation CostYu-Jie Zhang, Masashi SugiyamaNeurIPS 2023 · 被引用 34 次
- Generalized Linear Bandits with Limited AdaptivityAyush Sawarni, Nirjhar Das, Siddharth Barman, Gaurav SinhaNeurIPS 2024 · 被引用 23 次
- Automated Creative Optimization for E-Commerce AdvertisingJin Chen, Ju Xu, Gangwei Jiang, Tiezheng Ge 等WWW 2021 · 被引用 22 次
相关 Paper
- Practical and Optimal Algorithm for Linear Contextual Bandits with Rare Parameter UpdatesSanghoon Yu, Min-hwan OhICML 2026 · 被引用 1 次
- Linear bandits with limited adaptivity and learning distributional optimal designYufei Ruan, Jiaqi Yang, Yuan ZhouSTOC 2021 · 被引用 19 次
- Universal and data-adaptive algorithms for model selection in linear contextual banditsVidya K. Muthukumar, Akshay KrishnamurthyICML 2022 · 被引用 5 次
- Double Doubly Robust Thompson Sampling for Generalized Linear Contextual BanditsWonyoung Kim, Kyungbok Lee, Myunghee Cho PaikAAAI 2023 · 被引用 19 次
- Contextual Multinomial Logit Bandits with General Value FunctionsMengxiao Zhang, Haipeng LuoNeurIPS 2024 · 被引用 5 次
