SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equations
Grigory Bartosh, Dmitry P. Vetrov, Christian A. Naesseth
摘要
The Latent Stochastic Differential Equation (SDE) is a powerful tool for time series and sequence modeling. However, training Latent SDEs typically relies on adjoint sensitivity methods, which depend on simulation and backpropagation through approximate SDE solutions, which limit scalability. In this work, we propose SDE Matching, a new simulation-free method for training Latent SDEs. Inspired by modern Score-and Flow Matching algorithms for learning generative dynamics, we extend these ideas to the domain of stochastic dynamics for time series and sequence modeling, eliminating the need for costly numerical simulations. Our results demonstrate that SDE Matching achieves performance comparable to adjoint sensitivity methods while drastically reducing computational complexity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper7
- Curly Flow Matching for Learning Non-gradient Field DynamicsKatarina Petrovic, Lazar Atanackovic, Viggo Moro, Kacper Kapusniak 等NeurIPS 2025 · 被引用 23 次
- In-Context Learning of Stochastic Differential Equations with Foundation Inference ModelsPatrick Seifner, Kostadin Cvejoski, David Berghaus, César Ali Ojeda Marin 等NeurIPS 2025 · 被引用 8 次
- SING: SDE Inference via Natural GradientsAmber Hu, Henry Smith, Scott W. LindermanNeurIPS 2025 · 被引用 6 次
- Neural Stochastic Flows: Solver-Free Modelling and Inference for SDE SolutionsNaoki Kiyohara, Edward Johns, Yingzhen LiNeurIPS 2025 · 被引用 5 次
- Diffusion Differentiable ResamplingJennifer R. Andersson, Zheng ZhaoICML 2026 · 被引用 2 次
它引用的顶会 Paper21
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar 等ICLR 2021 · 被引用 1,270 次
- Maximum Likelihood Training of Score-Based Diffusion ModelsYang Song, Conor Durkan, Iain Murray, Stefano ErmonNeurIPS 2021 · 被引用 958 次
- Practical and Asymptotically Exact Conditional Sampling in Diffusion ModelsLuhuan Wu, Brian L. Trippe, Christian A. Naesseth, David M. Blei 等NeurIPS 2023 · 被引用 276 次
- Stochastic Normalizing FlowsHao Wu, Jonas Köhler, Frank NoéNeurIPS 2020 · 被引用 230 次
相关 Paper
- Trajectory Flow Matching with Applications to Clinical Time Series ModellingXi Zhang, Yuan Pu, Yuki Kawamura, Andrew Loza 等NeurIPS 2024 · 被引用 44 次
- Amortized Reparametrization: Efficient and Scalable Variational Inference for Latent SDEsKevin Course, Prasanth B. NairNeurIPS 2023 · 被引用 17 次
- Simulation-Free Training of Neural ODEs on Paired DataSemin Kim, Jaehoon Yoo, Jinwoo Kim, Yeonwoo Cha 等NeurIPS 2024 · 被引用 10 次
- Efficient Training of Neural Stochastic Differential Equations by Matching Finite Dimensional DistributionsJianxin Zhang, Josh Viktorov, Doosan Jung, Emily PitlerICLR 2025
- AdjointDEIS: Efficient Gradients for Diffusion ModelsZander W. Blasingame, Chen LiuNeurIPS 2024 · 被引用 8 次
