Safe Time-Varying Optimization based on Gaussian Processes with Spatio-Temporal Kernel
Jialin Li, Marta Zagórowska, Giulia De Pasquale, Alisa Rupenyan, John Lygeros
Abstract
Ensuring safety is a key aspect in sequential decision making problems, such as robotics or process control. The complexity of the underlying systems often makes finding the optimal decision challenging, especially when the safety-critical system is time-varying. Overcoming the problem of optimizing an unknown time-varying reward subject to unknown time-varying safety constraints, we propose TVSafeOpt, a new algorithm built on Bayesian optimization with a spatio-temporal kernel. The algorithm is capable of safely tracking a time-varying safe region without the need for explicit change detection. Optimality guarantees are also provided for the algorithm when the optimization problem becomes stationary. We show that TVSafeOpt compares favorably against SafeOpt on synthetic data, both regarding safety and optimality. Evaluation on a realistic case study with gas compressors confirms that TVSafeOpt ensures safety when solving time-varying optimization problems with unknown reward and safety functions.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1aef2176-4be6-412d-a3ef-185b90fd55b8Cited by top-tier papers1
Ask how each one uses itRelated papers
- Provably Efficient Primal-Dual Reinforcement Learning for CMDPs with Non-stationary Objectives and ConstraintsYuhao Ding, Javad LavaeiAAAI 2023 · 32 citations
- Exploring and Exploiting Model Uncertainty in Bayesian OptimizationZishi Zhang, Tao Ren, Yijie PengNeurIPS 2025 · 1 citation
- Constrained Variational Policy Optimization for Safe Reinforcement LearningZuxin Liu, Zhepeng Cen, Vladislav Isenbaev, Wei Liu et al.ICML 2022 · 112 citations
- Towards Safe Policy Improvement for Non-Stationary MDPsYash Chandak, Scott M. Jordan, Georgios Theocharous, Martha White et al.NeurIPS 2020 · 47 citations
- Information-Theoretic Safe Exploration with Gaussian ProcessesAlessandro G. Bottero, Carlos E. Luis, Julia Vinogradska, Felix Berkenkamp et al.NeurIPS 2022 · 18 citations
