SGM-PINN: Sampling Graphical Models for Faster Training of Physics-Informed Neural Networks
John Anticev, Ali Aghdaei, Wuxinlin Cheng, Zhuo Feng
Abstract
SGM-PINN is a graph-based importance sampling framework to improve the training efficacy of Physics-Informed Neural Networks (PINNs) on parameterized problems. By applying a graph decomposition scheme to an undirected Probabilistic Graphical Model (PGM) built from the training dataset, our method generates node clusters encoding conditional dependence between training samples. Biasing sampling towards more important clusters allows smaller mini-batches and training datasets, improving training speed and accuracy. We additionally fuse an efficient robustness metric with residual losses to determine regions requiring additional sampling. Experiments demonstrate the advantages of the proposed framework, achieving 3× faster convergence compared to prior state-of-the-art sampling methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c69c26fd-fff9-42cc-af3c-e23bdfb3907bBuilds on3
- Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) SamplingArka Daw, Jie Bu, Sifan Wang, Paris Perdikaris et al.ICML 2023 · 95 citations
- Amortized Finite Element Analysis for Fast PDE-Constrained OptimizationTianju Xue, Alex Beatson, Sigrid Adriaenssens, Ryan P. AdamsICML 2020 · 35 citations
- SPADE: A Spectral Method for Black-Box Adversarial Robustness EvaluationWuxinlin Cheng, Chenhui Deng, Zhiqiang Zhao, Yaohui Cai et al.ICML 2021 · 24 citations
Related papers
- DMIS: Dynamic Mesh-Based Importance Sampling for Training Physics-Informed Neural NetworksZijiang Yang, Zhongwei Qiu, Dongmei FuAAAI 2023 · 19 citations
- RoPINN: Region Optimized Physics-Informed Neural NetworksHaixu Wu, Huakun Luo, Yuezhou Ma, Jianmin Wang et al.NeurIPS 2024 · 50 citations
- Improving Energy Natural Gradient Descent through Woodbury, Momentum, and RandomizationAndrés Guzmán-Cordero, Felix Dangel, Gil Goldshlager, Marius ZeinhoferNeurIPS 2025 · 17 citations
- Fast Inference for Probabilistic Graphical ModelsJiantong Jiang, Zeyi Wen, Atif Bin Mansoor, Ajmal MianUSENIX ATC 2024 · 4 citations
- Improved Training of Physics-Informed Neural Networks Using Energy-Based Priors: a Study on Electrical Impedance TomographyAkarsh Pokkunuru, Pedram Rooshenas, Thilo Strauss, Anuj Abhishek et al.ICLR 2023
