A Physics-preserved Transfer Learning Method for Differential Equations
Haoran Yang, Chuan-Xian Ren
Abstract
While data-driven methods such as neural operator have achieved great success in solving differential equations (DEs), they suffer from domain shift problems caused by different learning environments (with data bias or equation changes), which can be alleviated by transfer learning (TL). However, existing TL methods adopted in DEs problems lack either generalizability in general DEs problems or physics preservation during training. In this work, we focus on a general transfer learning method that adaptively correct the domain shift and preserve physical relation within the equation. Mathematically, we characterize the data domain as product distribution and the essential problems as distribution bias and operator bias. A Physics-preserved Optimal Tensor Transport (POTT) method that simultaneously admits generalizability to common DEs and physics preservation of specific problem is proposed to adapt the data-driven model to target domain, utilizing the pushforward distribution induced by the POTT map. Extensive experiments in simulation and real-world datasets demonstrate the superior performance, generalizability and physics preservation of the proposed POTT method.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7f710332-9a9a-4f75-a937-6ac7a2a71a94Builds on17
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- GNOT: A General Neural Operator Transformer for Operator LearningZhongkai Hao, Zhengyi Wang, Hang Su, Chengyang Ying et al.ICML 2023 · 375 citations
- Transolver: A Fast Transformer Solver for PDEs on General GeometriesHaixu Wu, Huakun Luo, Haowen Wang, Jianmin Wang et al.ICML 2024 · 228 citations
- Reusing the Task-specific Classifier as a Discriminator: Discriminator-free Adversarial Domain AdaptationLin Chen, Huaian Chen, Zhixiang Wei, Xin Jin et al.CVPR 2022 · 197 citations
- Scalable Transformer for PDE Surrogate ModelingZijie Li, Dule Shu, Amir Barati FarimaniNeurIPS 2023 · 188 citations
Related papers
- Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics KnowledgeSiying (Sydney) Ma, Mehrdad Momeni Zadeh, Mauricio Soroco, Wuyang Chen et al.ICLR 2026 · 4 citations
- Data-Efficient Operator Learning via Unsupervised Pretraining and In-Context LearningWuyang Chen, Jialin Song, Pu Ren, Shashank Subramanian et al.NeurIPS 2024 · 41 citations
- Mapping conditional distributions for domain adaptation under generalized target shiftMatthieu Kirchmeyer, Alain Rakotomamonjy, Emmanuel de Bézenac, Patrick GallinariICLR 2022 · 26 citations
- DeltaPhi: Physical States Residual Learning for Neural Operators in Data-Limited PDE SolvingXihang Yue, Yi Yang, Linchao ZhuNeurIPS 2025 · 5 citations
- Imposing Boundary Conditions on Neural Operators via Learned Function ExtensionsSepehr Mousavi, Siddhartha Mishra, Laura De LorenzisICML 2026
