Transfer Learning Enhanced DeepONet for Long-Time Prediction of Evolution Equations
Wuzhe Xu, Yulong Lu, Li Wang
Abstract
Deep operator network (DeepONet) has demonstrated great success in various learning tasks, including learning solution operators of partial differential equations. In particular, it provides an efficient approach to predicting the evolution equations in a finite time horizon. Nevertheless, the vanilla DeepONet suffers from the issue of stability degradation in the long- time prediction. This paper proposes a transfer-learning aided DeepONet to enhance the stability. Our idea is to use transfer learning to sequentially update the DeepONets as the surro- gates for propagators learned in different time frames. The evolving DeepONets can better track the varying complexities of the evolution equations, while only need to be updated by efficient training of a tiny fraction of the operator networks. Through systematic experiments, we show that the proposed method not only improves the long-time accuracy of Deep- ONet while maintaining similar computational cost but also substantially reduces the sample size of the training set.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers6
- Towards Foundation Models for Scientific Machine Learning: Characterizing Scaling and Transfer BehaviorShashank Subramanian, Peter Harrington, Kurt Keutzer, Wahid Bhimji et al.NeurIPS 2023 · 173 citations
- Multiple Physics Pretraining for Spatiotemporal Surrogate ModelsMichael McCabe, Bruno Régaldo-Saint Blancard, Liam Holden Parker, Ruben Ohana et al.NeurIPS 2024 · 97 citations
- Learning Data-Efficient and Generalizable Neural Operators via Fundamental Physics KnowledgeSiying (Sydney) Ma, Mehrdad Momeni Zadeh, Mauricio Soroco, Wuyang Chen et al.ICLR 2026 · 4 citations
- A Physics-preserved Transfer Learning Method for Differential EquationsHaoran Yang, Chuan-Xian RenNeurIPS 2025 · 1 citation
- PDE-Transformer: Efficient and Versatile Transformers for Physics SimulationsBenjamin J. Holzschuh, Qiang Liu, Georg Kohl, Nils ThuereyICML 2025
Builds on1
Related papers
- Derivative-enhanced Deep Operator NetworkYuan Qiu, Nolan Bridges, Peng ChenNeurIPS 2024 · 25 citations
- DeltaPhi: Physical States Residual Learning for Neural Operators in Data-Limited PDE SolvingXihang Yue, Yi Yang, Linchao ZhuNeurIPS 2025 · 5 citations
- Nonlinear Reconstruction for Operator Learning of PDEs with DiscontinuitiesSamuel Lanthaler, Roberto Molinaro, Patrik Hadorn, Siddhartha MishraICLR 2023 · 3 citations
- HyperDeepONet: learning operator with complex target function space using the limited resources via hypernetworkJae Yong Lee, Sung Woong Cho, Hyung Ju HwangICLR 2023 · 3 citations
- Physics-Informed Deep Inverse Operator Networks for Solving PDE Inverse ProblemsSung Woong Cho, Hwijae SonICLR 2025
