A Schrödinger Eigenfunction Method for Long-Horizon Stochastic Optimal Control
Louis Claeys, Artur Goldman, Zebang Shen, Niao He
摘要
High-dimensional stochastic optimal control (SOC) becomes harder with longer planning horizons: existing methods scale linearly in the horizon , with performance often deteriorating exponentially. We overcome these limitations for a subclass of linearly-solvable SOC problems—those whose uncontrolled drift is the gradient of a potential. In this setting, the Hamilton-Jacobi-Bellman equation reduces to a linear PDE governed by an operator . We prove that, under the gradient drift assumption, is unitarily equivalent to a Schrödinger operator with purely discrete spectrum, allowing the long-horizon control to be efficiently described via the eigensystem of . This connection provides two key results: first, for a symmetric linear-quadratic regulator (LQR), matches the Hamiltonian of a quantum harmonic oscillator, whose closed-form eigensystem yields an analytic solution to the symmetric LQR with arbitrary terminal cost. Second, in a more general setting, we learn the eigensystem of using neural networks. We identify implicit reweighting issues with existing eigenfunction learning losses that degrade performance in control tasks, and propose a novel loss function to mitigate this. We evaluate our method on several long-horizon benchmarks, achieving an order-of-magnitude improvement in control accuracy compared to state-of-the-art methods, while reducing memory usage and runtime complexity from to .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper4
- Stochastic Optimal Control for Collective Variable Free Sampling of Molecular Transition PathsLars Holdijk, Yuanqi Du, Ferry Hooft, Priyank Jaini 等NeurIPS 2023 · 被引用 55 次
- Stochastic Optimal Control MatchingCarles Domingo-Enrich, Jiequn Han, Brandon Amos, Joan Bruna 等NeurIPS 2024 · 被引用 49 次
- The SSL Interplay: Augmentations, Inductive Bias, and GeneralizationVivien Cabannes, Bobak Toussi Kiani, Randall Balestriero, Yann LeCun 等ICML 2023 · 被引用 43 次
- Adjoint Matching: Fine-tuning Flow and Diffusion Generative Models with Memoryless Stochastic Optimal ControlCarles Domingo-Enrich, Michal Drozdzal, Brian Karrer, Ricky T. Q. ChenICLR 2025 · 被引用 2 次
相关 Paper
- Deep learning for continuous-time stochastic control with jumpsPatrick Cheridito, Jean-Loup Dupret, Donatien HainautNeurIPS 2025 · 被引用 8 次
- Differentiable Quantum Computing for Large-scale Linear ControlConnor Clayton, Jiaqi Leng, Gengzhi Yang, Yi-Ling Qiao 等NeurIPS 2024 · 被引用 7 次
- Deep Stochastic MechanicsElena Orlova, Aleksei Ustimenko, Ruoxi Jiang, Peter Y. Lu 等ICML 2024 · 被引用 2 次
- Efficient Quantum Algorithms for Quantum Optimal ControlXiantao Li, Chunhao WangICML 2023 · 被引用 6 次
- Hamiltonian Neural PDE Solvers through Functional ApproximationAnthony Y. Zhou, Amir Barati FarimaniNeurIPS 2025 · 被引用 1 次
