Divide and Conquer: Region Self-Paced Physics-Informed Neural Networks
Ruixuan Meng, Wenyuan Wu, Zhenwen Ren, Dezhong Peng, Yuan Sun, Xiaogang Deng
Abstract
Recently, Physics-Informed Neural Networks (PINNs) have shown strong potential in scientific computing and engineering simulation. Although existing PINN methods have achieved promising progress, they still suffer from the Unbalanced Prediction Problem (UPP), where challenging regions are learned much worse than smooth regions. To alleviate this issue, adaptive sampling and cognitive learning strategies have been introduced to emphasize hard samples by dynamically evaluating sample difficulty. However, the coupling between sample selection and difficulty evaluation may make many samples receive nearly indistinguishable difficulty scores, leading to the Difficulty Cohesion Problem (DCP). This problem weakens the intended easy-to-hard curriculum and limits the learning efficiency of PINNs. To address both UPP and DCP, we propose Region Self-Paced Physics-Informed Neural Networks (RSPINNs), a divide-and-conquer framework for time-dependent PDEs. Specifically, RSPINNs partitions the temporal domain into multiple subdomains and evaluates sample difficulty independently within each subdomain using PDE residual gradients. Then, a rank-based normalization strategy preserves the relative easy-to-hard ordering and improves difficulty discrimination. Finally, a bimodal self-paced scheduler converts the ranked difficulty index into smooth sample weights, guiding the model to progressively shift attention from easy to hard samples. Extensive experiments on six PDE benchmarks demonstrate that RSPINNs consistently improves prediction accuracy in challenging regions and achieves competitive overall performance with practical computational cost.
Ask about this paper
Ask your agent about it.
Lune has read the top-tier papers around this one, so every answer names the papers it rests on.
Related papers
- CoPINN: Cognitive Physics-Informed Neural NetworksSiyuan Duan, Wenyuan Wu, Peng Hu, Zhenwen Ren et al.ICML 2025
- TINNs: Time-Induced Neural Networks for Solving Time-Dependent PDEsChen-Yang Dai, Che-Chia Chang, Te-Sheng Lin, Ming-Chih Lai et al.ICML 2026 · 2 citations
- Mitigating Propagation Failures in Physics-informed Neural Networks using Retain-Resample-Release (R3) SamplingArka Daw, Jie Bu, Sifan Wang, Paris Perdikaris et al.ICML 2023 · 95 citations
- Mitigating Instability in High Residual Adaptive Sampling for PINNs via Langevin DynamicsMinseok Jeong, Giup Seo, Euiseok HwangNeurIPS 2025 · 2 citations
- DATS: Difficulty-Aware Task Sampler for Meta-Learning Physics-Informed Neural NetworksMaryam Toloubidokhti, Yubo Ye, Ryan Missel, Xiajun Jiang et al.ICLR 2024 · 14 citations
