A Plug-and-Play Query Synthesis Active Learning Framework for Neural PDE Solvers
Zhiyuan Wang, Jinwoo Go, Byung-Jun Yoon, Nathan M. Urban, Xiaoning Qian
Abstract
In recent developments in scientific machine learning (SciML), neural surrogate solvers for partial differential equations (PDEs) have become powerful tools for accelerating scientific computation for various science and engineering applications. However, training neural PDE solvers often demands a large amount of high-fidelity PDE simulation data, which are expensive to generate. Active learning (AL) offers a promising solution by adaptively selecting training data from the PDE settings–including parameters, initial and boundary conditions–that are expected to be most informative to help reduce this data burden. In this work, we introduce PaPQS, a P lug-a nd-P lay Q uery S ynthesis AL framework that synthesizes informative PDE settings directly in the continuous design space. PaPQS optimizes the Expected Information Gain (EIG) while encouraging batch diversity, enabling model-aware exploration of the design space via backpropagation through the neural PDE solution trajectories. The framework is applicable to general PDE systems and surrogate architectures, and can be seamlessly integrated with existing AL strategies. Extensive experiments across different PDE systems demonstrate that our AL framework, PaPQS, consistently improves sample efficiency over existing AL baselines.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on11
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Message Passing Neural PDE SolversJohannes Brandstetter, Daniel E. Worrall, Max WellingICLR 2022 · 410 citations
- PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE SolversPhillip Lippe, Bas Veeling, Paris Perdikaris, Richard E. Turner et al.NeurIPS 2023 · 280 citations
- Batch Active Learning at ScaleGui Citovsky, Giulia DeSalvo, Claudio Gentile, Lazaros Karydas et al.NeurIPS 2021 · 220 citations
- Gone Fishing: Neural Active Learning with Fisher EmbeddingsJordan T. Ash, Surbhi Goel, Akshay Krishnamurthy, Sham M. KakadeNeurIPS 2021 · 124 citations
Related papers
- Active Learning for Neural PDE SolversDaniel Musekamp, Marimuthu Kalimuthu, David Holzmüller, Makoto Takamoto et al.ICLR 2025
- Active Learning with Selective Time-Step Acquisition for PDEsYegon Kim, Hyunsu Kim, Gyeonghoon Ko, Juho LeeICML 2025
- Learning Neural PDE Solvers with Parameter-Guided Channel AttentionMakoto Takamoto, Francesco Alesiani, Mathias NiepertICML 2023 · 41 citations
- Deep Bayesian Active Learning for Accelerating Stochastic SimulationDongxia Wu, Ruijia Niu, Matteo Chinazzi, Alessandro Vespignani et al.KDD 2023 · 3 citations
- Training Deep Surrogate Models with Large Scale Online LearningLucas Thibaut Meyer, Marc Schouler, Robert Alexander Caulk, Alejandro Ribés et al.ICML 2023 · 10 citations
