Transolver++: An Accurate Neural Solver for PDEs on Million-Scale Geometries
Huakun Luo, Haixu Wu, Hang Zhou, Lanxiang Xing, Yichen Di, Jianmin Wang, Mingsheng Long
Abstract
Although deep models have been widely explored in solving partial differential equations (PDEs), previous works are primarily limited to data only with up to tens of thousands of mesh points, far from the million-point scale required by industrial simulations that involve complex geometries. In the spirit of advancing neural PDE solvers to real industrial applications, we present Tran-solver++, a highly parallel and efficient neural solver that can accurately solve PDEs on millionscale geometries. Building upon previous advancements in solving PDEs by learning physical states via Transolver, Transolver++ is further equipped with an extremely optimized parallelism framework and a local adaptive mechanism to efficiently capture eidetic physical states from massive mesh points, successfully tackling the thorny challenges in computation and physics learning when scaling up input mesh size. Tran-solver++ increases the single-GPU input capacity to million-scale points for the first time and is capable of continuously scaling input size in linear complexity by increasing GPUs. Experimentally, Transolver++ yields 13% relative promotion across six standard PDE benchmarks and achieves over 20% performance gain in million-scale highfidelity industrial simulations, whose sizes are 100⇥ larger than previous benchmarks, covering car and 3D aircraft designs. Code is available at https://github.com/thuml/Transolver plus .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d32ab1e2-6552-413e-972d-123066718512Cited by top-tier papers19
- Geometry Aware Operator Transformer as an efficient and accurate neural surrogate for PDEs on arbitrary domainsShizheng Wen, Arsh Kumbhat, Levi E. Lingsch, Sepehr Mousavi et al.NeurIPS 2025 · 73 citations
- GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-TrainingHaixu Wu, Minghao Guo, Zongyi Li, Zhiyang Dou et al.ICML 2026 · 6 citations
- Adaptive Mamba Neural OperatorsZeyuan Song, Zheyu JiangICLR 2026 · 6 citations
- Locally Subspace-Informed Neural Operators for Efficient Multiscale PDE SolvingAlexander Rudikov, Vladimir Fanaskov, Sergei Stepanov, Buzheng Shan et al.ICLR 2026 · 4 citations
- MSPT: Efficient Large-Scale Physical Modeling via Parallelized Multi-Scale AttentionPedro M. P. Curvo, Jan-Willem van de Meent, Maksim ZhdanovCVPR 2026 · 3 citations
Builds on17
- FlashAttention: Fast and Memory-Efficient Exact Attention with IO-AwarenessTri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra et al.NeurIPS 2022 · 5,493 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Reformer: The Efficient TransformerNikita Kitaev, Lukasz Kaiser, Anselm LevskayaICLR 2020 · 2,878 citations
- Learning Mesh-Based Simulation with Graph NetworksTobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, Peter W. BattagliaICLR 2021 · 1,175 citations
- Choose a Transformer: Fourier or GalerkinShuhao CaoNeurIPS 2021 · 516 citations
Related papers
- Transolver-3: Scaling Up Transformer Solvers to Industrial-Scale GeometriesHang Zhou, Haixu Wu, Haonan Shangguan, Yuezhou Ma et al.ICML 2026
- Transolver: A Fast Transformer Solver for PDEs on General GeometriesHaixu Wu, Huakun Luo, Haowen Wang, Jianmin Wang et al.ICML 2024 · 228 citations
- Unisolver: PDE-Conditional Transformers Towards Universal Neural PDE SolversHang Zhou, Yuezhou Ma, Haixu Wu, Haowen Wang et al.ICML 2025
- Distributed multigrid neural solvers on megavoxel domainsAditya Balu, Sergio Botelho, Biswajit Khara, Vinay Rao et al.SC 2021 · 7 citations
- Text2PDE: Latent Diffusion Models for Accessible Physics SimulationAnthony Y. Zhou, Zijie Li, Michael Schneier, John R. Buchanan Jr. et al.ICLR 2025
