Safe Time-Varying Optimization based on Gaussian Processes with Spatio-Temporal Kernel
Jialin Li, Marta Zagórowska, Giulia De Pasquale, Alisa Rupenyan, John Lygeros
摘要
Ensuring safety is a key aspect in sequential decision making problems, such as robotics or process control. The complexity of the underlying systems often makes finding the optimal decision challenging, especially when the safety-critical system is time-varying. Overcoming the problem of optimizing an unknown time-varying reward subject to unknown time-varying safety constraints, we propose TVSafeOpt, a new algorithm built on Bayesian optimization with a spatio-temporal kernel. The algorithm is capable of safely tracking a time-varying safe region without the need for explicit change detection. Optimality guarantees are also provided for the algorithm when the optimization problem becomes stationary. We show that TVSafeOpt compares favorably against SafeOpt on synthetic data, both regarding safety and optimality. Evaluation on a realistic case study with gas compressors confirms that TVSafeOpt ensures safety when solving time-varying optimization problems with unknown reward and safety functions.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它相关 Paper
- Provably Efficient Primal-Dual Reinforcement Learning for CMDPs with Non-stationary Objectives and ConstraintsYuhao Ding, Javad LavaeiAAAI 2023 · 被引用 32 次
- Exploring and Exploiting Model Uncertainty in Bayesian OptimizationZishi Zhang, Tao Ren, Yijie PengNeurIPS 2025 · 被引用 1 次
- Constrained Variational Policy Optimization for Safe Reinforcement LearningZuxin Liu, Zhepeng Cen, Vladislav Isenbaev, Wei Liu 等ICML 2022 · 被引用 112 次
- Towards Safe Policy Improvement for Non-Stationary MDPsYash Chandak, Scott M. Jordan, Georgios Theocharous, Martha White 等NeurIPS 2020 · 被引用 47 次
- Information-Theoretic Safe Exploration with Gaussian ProcessesAlessandro G. Bottero, Carlos E. Luis, Julia Vinogradska, Felix Berkenkamp 等NeurIPS 2022 · 被引用 18 次
