Smoothed Online Combinatorial Optimization Using Imperfect Predictions
Kai Wang, Zhao Song, Georgios Theocharous, Sridhar Mahadevan
Abstract
Smoothed online combinatorial optimization considers a learner who repeatedly chooses a combinatorial decision to minimize an unknown changing cost function with a penalty on switching decisions in consecutive rounds. We study smoothed online combinatorial optimization problems when an imperfect predictive model is available, where the model can forecast the future cost functions with uncertainty. We show that using predictions to plan for a finite time horizon leads to regret dependent on the total predictive uncertainty and an additional switching cost. This observation suggests choosing a suitable planning window to balance between uncertainty and switching cost, which leads to an online algorithm with guarantees on the upper and lower bounds of the cumulative regret. Empirically, our algorithm shows a significant improvement in cumulative regret compared to other baselines in synthetic online distributed streaming problems.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 95f8fcf9-256b-4515-9954-3f3db02e26c5Builds on4
- Online metric algorithms with untrusted predictionsAntonios Antoniadis, Christian Coester, Marek Eliás, Adam Polak et al.ICML 2020 · 170 citations
- Chasing Nested Convex Bodies Nearly OptimallySébastien Bubeck, Bo'az Klartag, Yin Tat Lee, Yuanzhi Li et al.SODA 2020 · 41 citations
- Chasing Convex Bodies OptimallyMark SellkeSODA 2020 · 36 citations
- Leveraging Predictions in Smoothed Online Convex Optimization via Gradient-based AlgorithmsYingying Li, Na LiNeurIPS 2020 · 30 citations
Related papers
- Online Classification with PredictionsVinod Raman, Ambuj TewariNeurIPS 2024 · 9 citations
- Revisiting Smoothed Online LearningLijun Zhang, Wei Jiang, Shiyin Lu, Tianbao YangNeurIPS 2021 · 41 citations
- Smoothed Online Convex Optimization Based on Discounted-Normal-PredictorLijun Zhang, Wei Jiang, Jinfeng Yi, Tianbao YangNeurIPS 2022 · 13 citations
- Online Convex Optimization with Continuous Switching ConstraintGuanghui Wang, Yuanyu Wan, Tianbao Yang, Lijun ZhangNeurIPS 2021 · 14 citations
- Online Convex Optimisation: The Optimal Switching Regret for all Segmentations SimultaneouslyStephen Pasteris, Chris Hicks, Vasilios Mavroudis, Mark HerbsterNeurIPS 2024 · 4 citations
