Tracking Most Significant Shifts in Infinite-Armed Bandits
Joe Suk, Jung-hun Kim
2025Year
1Top-tier citations
Abstract
We study an infinite-armed bandit problem where actions' mean rewards are initially sampled from a reservoir distribution. Most prior works in this setting focused on stationary rewards (
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 65712c15-e6e5-426e-a3cb-a9ec0becb823Cited by top-tier papers1
Ask how each one uses itBuilds on5
- Smooth Non-stationary BanditsSu Jia, Qian Xie, Nathan Kallus, Peter I. FrazierICML 2023 · 14 citations
- Unreasonable Effectiveness of Greedy Algorithms in Multi-Armed Bandit with Many ArmsMohsen Bayati, Nima Hamidi, Ramesh Johari, Khashayar KhosraviNeurIPS 2020 · 10 citations
- Rotting Infinitely Many-Armed BanditsJung-Hun Kim, Milan Vojnovic, Se-Young YunICML 2022 · 5 citations
- When Can We Track Significant Preference Shifts in Dueling Bandits?Joe Suk, Arpit AgarwalNeurIPS 2023 · 5 citations
- An Adaptive Approach for Infinitely Many-armed Bandits under Generalized Rotting ConstraintsJung-Hun Kim, Milan Vojnovic, Se-Young YunNeurIPS 2024 · 2 citations
Related papers
- Beyond the Best: Distribution Functional Estimation in Infinite-Armed BanditsYifei Wang, Tavor Z. Baharav, Yanjun Han, Jiantao Jiao et al.NeurIPS 2022 · 2 citations
- Bandits for BMO FunctionsTianyu Wang, Cynthia RudinICML 2020 · 5 citations
- Rebounding Bandits for Modeling Satiation EffectsLiu Leqi, Fatma Kilinç-Karzan, Zachary C. Lipton, Alan L. MontgomeryNeurIPS 2021 · 30 citations
- Dynamic Planning and Learning under Recovering RewardsDavid Simchi-Levi, Zeyu Zheng, Feng ZhuICML 2021 · 6 citations
- A New Framework: Short-Term and Long-Term Returns in Stochastic Multi-Armed BanditAbdalaziz Sawwan, Jie WuINFOCOM 2023 · 11 citations
