Unbiased and Second-Order-Free Training for High-Dimensional PDEs
Jaemin Seo, Su Rin Lee, JaeYong Lee
摘要
Deep learning methods based on backward stochastic differential equations (BSDEs) have emerged as competitive alternatives to physicsinformed neural networks (PINNs) for solving high-dimensional partial differential equations (PDEs). By leveraging probabilistic representations, BSDE approaches can avoid the curse of dimensionality and often admit second-order-free training objectives that do not require explicit Hessian evaluations. It has recently been established that the commonly used Euler-Maruyama (EM) time discretization induces an intrinsic bias in BSDE training losses. While high-order schemes such as Heun can fully eliminate this bias, such schemes re-introduce second-order spatial derivatives and incur substantial computational overhead. In this work, we provide a principled analysis of EM-induced loss bias and propose an unbiased, second-order-free training framework that preserves the computational advantages of BSDE methods. Our code is available at https://github.com/seojaemin22/ Un-EM-BSDE .
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper5
- Challenges in Training PINNs: A Loss Landscape PerspectivePratik Rathore, Weimu Lei, Zachary Frangella, Lu Lu 等ICML 2024 · 被引用 137 次
- A Unified Hard-Constraint Framework for Solving Geometrically Complex PDEsSongming Liu, Zhongkai Hao, Chengyang Ying, Hang Su 等NeurIPS 2022 · 被引用 47 次
- Stochastic Taylor Derivative Estimator: Efficient amortization for arbitrary differential operatorsZekun Shi, Zheyuan Hu, Min Lin, Kenji KawaguchiNeurIPS 2024 · 被引用 32 次
- Randomized Automatic DifferentiationDeniz Oktay, Nick McGreivy, Joshua Aduol, Alex Beatson 等ICLR 2021 · 被引用 31 次
- Collapsing Taylor Mode Automatic DifferentiationFelix Dangel, Tim Siebert, Marius Zeinhofer, Andrea WaltherNeurIPS 2025 · 被引用 1 次
相关 Paper
- Integration Matters for Learning PDEs with Backward SDEsSungje Park, Stephen TuNeurIPS 2025
- Generic bounds on the approximation error for physics-informed (and) operator learningTim De Ryck, Siddhartha MishraNeurIPS 2022 · 被引用 93 次
- Accelerated Training of Physics-Informed Neural Networks (PINNs) using Meshless DiscretizationsRamansh Sharma, Varun ShankarNeurIPS 2022 · 被引用 81 次
- How does PDE order affect the convergence of PINNs?Changhoon Song, Yesom Park, Myungjoo KangNeurIPS 2024 · 被引用 17 次
- MultiAdam: Parameter-wise Scale-invariant Optimizer for Multiscale Training of Physics-informed Neural NetworksJiachen Yao, Chang Su, Zhongkai Hao, Songming Liu 等ICML 2023 · 被引用 27 次
