Energy Transformer
Benjamin Hoover, Yuchen Liang, Bao Pham, Rameswar Panda, Hendrik Strobelt, Duen Horng Chau, Mohammed J. Zaki, Dmitry Krotov
Abstract
Machine learning methods have shown great success in various scientific areas, including fluid mechanics. However, reconstruction problems, where full velocity fields must be recovered from partial observations, remain challenging. In this paper, we propose a novel operator learning framework for solving reconstruction problems by using the Energy Transformer (ET), an architecture inspired by associative memory models. We formulate reconstruction as a mapping from incomplete observed data to full reconstructed fields. The method is validated on three fluid mechanics examples using diverse types of data: (1) unsteady 2D vortex street in flow past a cylinder using simulation data; (2) high-speed under-expanded impinging supersonic jets impingement using Schlieren imaging; and (3) 3D turbulent jet flow using particle tracking. The results demonstrate the ability of ET to accurately reconstruct complex flow fields from highly incomplete data (90% missing), even for noisy experimental measurements, with fast training and inference on a single GPU. This work provides a promising new direction for tackling reconstruction problems in fluid mechanics and other areas in mechanics, geophysics, weather prediction, and beyond.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 263ff14c-e247-4f35-8f44-4b545032f9deCited by top-tier papers20
- Energy-Based Transformers are Scalable Learners and ThinkersAlexi Gladstone, Ganesh Nanduru, Md Mofijul Islam, Peixuan Han et al.ICLR 2026 · 38 citations
- Guided Diffusion Sampling on Function Spaces with Applications to PDEsJiachen Yao, Abbas Mammadov, Julius Berner, Gavin Kerrigan et al.NeurIPS 2025 · 37 citations
- Dense Associative Memory Through the Lens of Random FeaturesBenjamin Hoover, Duen Horng Chau, Hendrik Strobelt, Parikshit Ram et al.NeurIPS 2024 · 18 citations
- Sparse and Structured Hopfield NetworksSaul José Rodrigues dos Santos, Vlad Niculae, Daniel C. McNamee, André F. T. MartinsICML 2024 · 12 citations
- Deep sequence models tend to memorize geometrically; it is unclear whyShahriar Noroozizadeh, Vaishnavh Nagarajan, Elan Rosenfeld, Sanjiv KumarICML 2026 · 11 citations
Builds on2
- Fourier Neural Operator for Parametric Partial Differential EquationsZongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu et al.ICLR 2021 · 3,911 citations
- Large Associative Memory Problem in Neurobiology and Machine LearningDmitry Krotov, John J. HopfieldICLR 2021 · 202 citations
Related papers
- Physics-Informed Diffusion ModelsJan-Hendrik Bastek, WaiChing Sun, Dennis M. KochmannICLR 2025 · 165 citations
- Incomplete Data, Complete Dynamics: A Diffusion ApproachZihan Zhou, Chenguang Wang, Hongyi Ye, Yongtao Guan et al.ICLR 2026 · 3 citations
- EAGLE: Large-scale Learning of Turbulent Fluid Dynamics with Mesh TransformersSteeven Janny, Aurélien Béneteau, Madiha Nadri, Julie Digne et al.ICLR 2023 · 5 citations
- Physics-enhanced Neural Operator: An Application in Simulating Turbulent TransportShengyu Chen, Peyman Givi, Can Zheng, Xiaowei JiaKDD 2026
- CViT: Continuous Vision Transformer for Operator LearningSifan Wang, Jacob H. Seidman, Shyam Sankaran, Hanwen Wang et al.ICLR 2025
