Bayesian Optimization through Gaussian Cox Process Models for Spatio-temporal Data
Yongsheng Mei, Mahdi Imani, Tian Lan
摘要
Bayesian optimization (BO) has established itself as a leading strategy for efficiently optimizing expensive-to-evaluate functions. Existing BO methods mostly rely on Gaussian process (GP) surrogate models and are not applicable to (doubly-stochastic) Gaussian Cox processes, where the observation process is modulated by a latent intensity function modeled as a GP. In this paper, we propose a novel maximum a posteriori inference of Gaussian Cox processes. It leverages the Laplace approximation and change of kernel technique to transform the problem into a new reproducing kernel Hilbert space, where it becomes more tractable computationally. It enables us to obtain both a functional posterior of the latent intensity function and the covariance of the posterior, thus extending existing works that often focus on specific link functions or estimating the posterior mean. Using the result, we propose a BO framework based on the Gaussian Cox process model and further develop a Nyström approximation for efficient computation. Extensive evaluations on various synthetic and real-world datasets demonstrate significant improvement over state-of-the-art inference solutions for Gaussian Cox processes, as well as effective BO with a wide range of acquisition functions designed through the underlying Gaussian Cox process model.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper7
- Accelerating Bayesian Optimization for Biological Sequence Design with Denoising AutoencodersSamuel Stanton, Wesley J. Maddox, Nate Gruver, Phillip M. Maffettone 等ICML 2022 · 被引用 137 次
- Every Parameter Matters: Ensuring the Convergence of Federated Learning with Dynamic Heterogeneous Models ReductionHanhan Zhou, Tian Lan, Guru Venkataramani, Wenbo DingNeurIPS 2023 · 被引用 64 次
- PAC: Assisted Value Factorization with Counterfactual Predictions in Multi-Agent Reinforcement LearningHanhan Zhou, Tian Lan, Vaneet AggarwalNeurIPS 2022 · 被引用 47 次
- Bringing Fairness to Actor-Critic Reinforcement Learning for Network Utility OptimizationJingdi Chen, Yimeng Wang, Tian LanINFOCOM 2021 · 被引用 23 次
- Scalable Multi-agent Covering Option Discovery based on Kronecker GraphsJiayu Chen, Jingdi Chen, Tian Lan, Vaneet AggarwalNeurIPS 2022 · 被引用 16 次
相关 Paper
- Fast Bayesian Inference for Gaussian Cox Processes via Path Integral FormulationHideaki KimNeurIPS 2021 · 被引用 8 次
- Modulating Surrogates for Bayesian OptimizationErik Bodin, Markus Kaiser, Ieva Kazlauskaite, Zhenwen Dai 等ICML 2020 · 被引用 11 次
- High-Dimensional Bayesian Optimization via Nested Riemannian ManifoldsNoémie Jaquier, Leonel Dario RozoNeurIPS 2020 · 被引用 33 次
- Objective Bound Conditional Gaussian Process for Bayesian OptimizationTaewon Jeong, Heeyoung KimICML 2021 · 被引用 3 次
- Re-Examining Linear Embeddings for High-Dimensional Bayesian OptimizationBenjamin Letham, Roberto Calandra, Akshara Rai, Eytan BakshyNeurIPS 2020 · 被引用 152 次
