Multinomial Logit Bandit with Low Switching Cost
Kefan Dong, Yingkai Li, Qin Zhang, Yuan Zhou
2020年份
18被引次数
10顶会引用
摘要
We study multinomial logit bandit with limited adaptivity, where the algorithms change their exploration actions as infrequently as possible when achieving almost optimal minimax regret. We propose two measures of adaptivity: the assortment switching cost and the more fine-grained item switching cost. We present an anytime algorithm (AT-DUCB) with assortment switches, almost matching the lower bound . In the fixed-horizon setting, our algorithm FH-DUCB incurs assortment switches, matching the asymptotic lower bound. We also present the ESUCB algorithm with item switching cost .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper10
- Linear bandits with limited adaptivity and learning distributional optimal designYufei Ruan, Jiaqi Yang, Yuan ZhouSTOC 2021 · 被引用 19 次
- UCB-based Algorithms for Multinomial Logistic Regression BanditsSanae Amani, Christos ThrampoulidisNeurIPS 2021 · 被引用 18 次
- Near-Optimal Regret Bounds for Multi-batch Reinforcement LearningZihan Zhang, Yuhang Jiang, Yuan Zhou, Xiangyang JiNeurIPS 2022 · 被引用 16 次
- Online Convex Optimization with Continuous Switching ConstraintGuanghui Wang, Yuanyu Wan, Tianbao Yang, Lijun ZhangNeurIPS 2021 · 被引用 14 次
- Reinforcement Learning with Logarithmic Regret and Policy SwitchesGrigoris Velegkas, Zhuoran Yang, Amin KarbasiNeurIPS 2022 · 被引用 7 次
相关 Paper
- Nearly Minimax Optimal Regret for Multinomial Logistic BanditJoongkyu Lee, Min-hwan OhNeurIPS 2024 · 被引用 20 次
- Better Best of Both Worlds Bounds for Bandits with Switching CostsIdan Amir, Guy Azov, Tomer Koren, Roi LivniNeurIPS 2022 · 被引用 21 次
- An Algorithm for Stochastic and Adversarial Bandits with Switching CostsChloé Rouyer, Yevgeny Seldin, Nicolò Cesa-BianchiICML 2021 · 被引用 28 次
- Multinomial Logit Contextual Bandits: Provable Optimality and PracticalityMin-hwan Oh, Garud IyengarAAAI 2021 · 被引用 29 次
- Almost Optimal Anytime Algorithm for Batched Multi-Armed BanditsTianyuan Jin, Jing Tang, Pan Xu, Keke Huang 等ICML 2021 · 被引用 25 次
