Hierarchical Implicit Neural Emulators
Ruoxi Jiang, Xiao Zhang, Karan Jakhar, Peter Y. Lu, Pedram Hassanzadeh, Michael Maire, Rebecca Willett
Abstract
Neural PDE solvers offer a powerful tool for modeling complex dynamical systems, but often struggle with error accumulation over long time horizons and maintaining stability and physical consistency. We introduce a multiscale implicit neural emulator that enhances long-term prediction accuracy by conditioning on a hierarchy of lower-dimensional future state representations. Inspired by the stability properties of numerical implicit time-stepping methods, we developed an approach that leverages predictions several steps ahead in time at increasing compression rates for next-timestep refinements. By actively adjusting the temporal downsampling ratios, our design enables the model to capture dynamics across multiple granularities and enforce long-range temporal coherence. Experiments on turbulent fluid dynamics show that our method achieves high short-term accuracy and produces long-term stable forecasts, significantly outperforming non-hierarchical autoregressive baselines while adding minimal computational overhead. The codebase is available at this link 1 .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6503d288-a399-4622-bafb-b93705706f27Cited by top-tier papers5
- Cheap2Rich: A Multi-Fidelity Framework for Data Assimilation and System Identification of Multiscale Physics - Rotating Detonation EnginesYuxuan Bao, Jan Zajac, Megan Powers, Venkat Raman et al.ICML 2026 · 3 citations
- Nested Spatio-Temporal Time Series ForecastingYingHao Ai, Yukai Zhou, Ruoxi Jiang, Junyi An et al.ICML 2026 · 1 citation
- Learning to Emulate Chaos: Adversarial Optimal Transport RegularizationGabriel Melo, Leonardo Santiago, Peter Y. LuICML 2026 · 1 citation
- CoEvol-NO: State and Coordinate Co-Evolution with an Error-Driven Predictor-Corrector Paradigm for Neural Operator TransformerJianqiao Zeng, Ruocheng Wang, Yanzhi Liu, Hao Xiong et al.ICML 2026
- SENDAI: A Hierarchical Sparse-measurement, EfficieNt Data AssImilation FrameworkXingyue Zhang, Yuxuan Bao, Mars Liyao Gao, J. Nathan KutzICML 2026
Builds on15
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Multiscale Vision TransformersHaoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li et al.ICCV 2021 · 1,611 citations
- NVAE: A Deep Hierarchical Variational AutoencoderArash Vahdat, Jan KautzNeurIPS 2020 · 1,141 citations
- Multipole Graph Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola B. Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.NeurIPS 2020 · 569 citations
Related papers
- MultiPDENet: PDE-embedded Learning with Multi-time-stepping for Accelerated Flow SimulationQi Wang, Yuan Mi, Haoyun Wang, Yi Zhang et al.ICML 2025
- Hybrid Latent Representations for PDE EmulationAli Can Bekar, Siddhant Agarwal, Christian Hüttig, Nicola Tosi et al.NeurIPS 2025 · 2 citations
- PDE-Refiner: Achieving Accurate Long Rollouts with Neural PDE SolversPhillip Lippe, Bas Veeling, Paris Perdikaris, Richard E. Turner et al.NeurIPS 2023 · 280 citations
- INC: An Indirect Neural Corrector for Auto-Regressive Hybrid PDE SolversHao Wei, Aleksandra Franz, Björn List, Nils ThuereyNeurIPS 2025 · 4 citations
- Neural Emulator Superiority: When Machine Learning for PDEs Surpasses its Training DataFelix Koehler, Nils ThuereyNeurIPS 2025 · 8 citations
