Multinomial Logit Bandit with Low Switching Cost
Kefan Dong, Yingkai Li, Qin Zhang, Yuan Zhou
Abstract
We study multinomial logit bandit with limited adaptivity, where the algorithms change their exploration actions as infrequently as possible when achieving almost optimal minimax regret. We propose two measures of adaptivity: the assortment switching cost and the more fine-grained item switching cost. We present an anytime algorithm (AT-DUCB) with assortment switches, almost matching the lower bound . In the fixed-horizon setting, our algorithm FH-DUCB incurs assortment switches, matching the asymptotic lower bound. We also present the ESUCB algorithm with item switching cost .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers10
- Linear bandits with limited adaptivity and learning distributional optimal designYufei Ruan, Jiaqi Yang, Yuan ZhouSTOC 2021 · 19 citations
- UCB-based Algorithms for Multinomial Logistic Regression BanditsSanae Amani, Christos ThrampoulidisNeurIPS 2021 · 18 citations
- Near-Optimal Regret Bounds for Multi-batch Reinforcement LearningZihan Zhang, Yuhang Jiang, Yuan Zhou, Xiangyang JiNeurIPS 2022 · 16 citations
- Online Convex Optimization with Continuous Switching ConstraintGuanghui Wang, Yuanyu Wan, Tianbao Yang, Lijun ZhangNeurIPS 2021 · 14 citations
- Reinforcement Learning with Logarithmic Regret and Policy SwitchesGrigoris Velegkas, Zhuoran Yang, Amin KarbasiNeurIPS 2022 · 7 citations
Related papers
- Nearly Minimax Optimal Regret for Multinomial Logistic BanditJoongkyu Lee, Min-hwan OhNeurIPS 2024 · 20 citations
- Better Best of Both Worlds Bounds for Bandits with Switching CostsIdan Amir, Guy Azov, Tomer Koren, Roi LivniNeurIPS 2022 · 21 citations
- An Algorithm for Stochastic and Adversarial Bandits with Switching CostsChloé Rouyer, Yevgeny Seldin, Nicolò Cesa-BianchiICML 2021 · 28 citations
- Multinomial Logit Contextual Bandits: Provable Optimality and PracticalityMin-hwan Oh, Garud IyengarAAAI 2021 · 29 citations
- Almost Optimal Anytime Algorithm for Batched Multi-Armed BanditsTianyuan Jin, Jing Tang, Pan Xu, Keke Huang et al.ICML 2021 · 25 citations
