Disentangling Linear Quadratic Control with Untrusted ML Predictions
Tongxin Li, Hao Liu, Yisong Yue
摘要
Uncertain perturbations in dynamical systems often arise from diverse resources, represented by latent components. The predictions for these components, typically generated by “black-box” machine learning tools, are prone to inaccuracies. To tackle this challenge, we introduce D ISC , a novel policy that learns a confidence parameter online to harness the potential of accurate predictions while also mitigating the impact of erroneous forecasts. When predictions are precise, D ISC leverages this information to achieve near-optimal performance. Conversely, in the case of significant prediction errors, it still has a worst-case competitive ratio guarantee. We provide competitive ratio bounds for D ISC under both linear mixing of latent variables as well as a broader class of mixing functions. Our results highlight a first-of-its-kind “best-of-both-worlds” integration of machine-learned predictions, thus lead to a near-optimal consistency and robustness tradeoff, which provably improves what can be obtained without learning the confidence parameter. We validate the applicability of D ISC across a spectrum of practical scenarios.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper19
- Naive Exploration is Optimal for Online LQRMax Simchowitz, Dylan J. FosterICML 2020 · 被引用 209 次
- The Primal-Dual method for Learning Augmented AlgorithmsÉtienne Bamas, Andreas Maggiori, Ola SvenssonNeurIPS 2020 · 被引用 171 次
- Online metric algorithms with untrusted predictionsAntonios Antoniadis, Christian Coester, Marek Eliás, Adam Polak 等ICML 2020 · 被引用 170 次
- Optimal Robustness-Consistency Trade-offs for Learning-Augmented Online AlgorithmsAlexander Wei, Fred ZhangNeurIPS 2020 · 被引用 129 次
- Invariant Causal Representation Learning for Out-of-Distribution GeneralizationChaochao Lu, Yuhuai Wu, José Miguel Hernández-Lobato, Bernhard SchölkopfICLR 2022 · 被引用 119 次
相关 Paper
- Applied Online Algorithms with Heterogeneous PredictorsJessica Maghakian, Russell Lee, Mohammad Hajiesmaili, Jian Li 等ICML 2023 · 被引用 7 次
- Learning Augmented Energy Minimization via Speed ScalingÉtienne Bamas, Andreas Maggiori, Lars Rohwedder, Ola SvenssonNeurIPS 2020 · 被引用 84 次
- Pausing Policy Learning in Non-stationary Reinforcement LearningHyunin Lee, Ming Jin, Javad Lavaei, Somayeh SojoudiICML 2024 · 被引用 4 次
- Beyond Black-Box Advice: Learning-Augmented Algorithms for MDPs with Q-Value PredictionsTongxin Li, Yiheng Lin, Shaolei Ren, Adam WiermanNeurIPS 2023 · 被引用 14 次
- Robust and Consistent Ski Rental with Distributional AdviceJihwan Kim, Chenglin FanICML 2026 · 被引用 1 次
