GeoPT: Scaling Physics Simulation via Lifted Geometric Pre-Training
Haixu Wu, Minghao Guo, Zongyi Li, Zhiyang Dou, Mingsheng Long, Kaiming He, Wojciech Matusik
Abstract
Neural simulators promise efficient surrogates for physics simulation, but scaling them is bottlenecked by the prohibitive cost of generating high-fidelity training data. Pre-training on abundant off-the-shelf geometries offers a natural alternative, yet faces a fundamental gap: supervision on static geometry alone ignores dynamics and can lead to negative transfer on physics tasks. We present GeoPT, a unified pre-trained model for general physics simulation based on lifted geometric pre-training. The core idea is to augment geometry with synthetic dynamics, enabling dynamics-aware self-supervision without physics labels. Pre-trained on over one million samples, GeoPT consistently improves industrial-fidelity benchmarks spanning fluid mechanics for cars, aircraft, and ships, and solid mechanics in crash simulation, reducing labeled data requirements by 20-60% and accelerating convergence by 2. These results show that lifting with synthetic dynamics bridges the geometry-physics gap, unlocking a scalable path for neural simulation and potentially beyond. Code is available at https://github.com/Physics-Scaling/GeoPT.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 1c68b1ea-a774-4347-bea0-740efec8d4c5Cited by top-tier papers1
Ask how each one uses itBuilds on23
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Emerging Properties in Self-Supervised Vision TransformersMathilde Caron, Hugo Touvron, Ishan Misra, Hervé Jégou et al.ICCV 2021 · 8,921 citations
- Adding Conditional Control to Text-to-Image Diffusion ModelsLvmin Zhang, Anyi Rao, Maneesh AgrawalaICCV 2023 · 6,759 citations
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Learning Mesh-Based Simulation with Graph NetworksTobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, Peter W. BattagliaICLR 2021 · 1,175 citations
Related papers
- From Cheap Geometry to Expensive Physics: A Physics-agnostic Pretraining Framework for Neural OperatorsZhizhou Zhang, Youjia Wu, Kaixuan Zhang, Yanjia WangICLR 2026 · 1 citation
- Universal Physics Transformers: A Framework For Efficiently Scaling Neural OperatorsBenedikt Alkin, Andreas Fürst, Simon Schmid, Lukas Gruber et al.NeurIPS 2024 · 23 citations
- Mesh Based Simulations with Spatial and Temporal awarenessPaul Garnier, Vincent Lannelongue, Elie HachemICML 2026
- Sim2Reason: Solving Physics Olympiad via Reinforcement Learning on Physics SimulatorsMihir Prabhudesai, Aryan Satpathy, Yangmin Li, Zheyang Qin et al.ICML 2026 · 2 citations
- SNUG: Self-Supervised Neural Dynamic GarmentsIgor Santesteban, Miguel A. Otaduy, Dan CasasCVPR 2022 · 96 citations
