Energy Transformer
Benjamin Hoover, Yuchen Liang, Bao Pham, Rameswar Panda, Hendrik Strobelt, Duen Horng Chau, Mohammed J. Zaki, Dmitry Krotov
摘要
Machine learning methods have shown great success in various scientific areas, including fluid mechanics. However, reconstruction problems, where full velocity fields must be recovered from partial observations, remain challenging. In this paper, we propose a novel operator learning framework for solving reconstruction problems by using the Energy Transformer (ET), an architecture inspired by associative memory models. We formulate reconstruction as a mapping from incomplete observed data to full reconstructed fields. The method is validated on three fluid mechanics examples using diverse types of data: (1) unsteady 2D vortex street in flow past a cylinder using simulation data; (2) high-speed under-expanded impinging supersonic jets impingement using Schlieren imaging; and (3) 3D turbulent jet flow using particle tracking. The results demonstrate the ability of ET to accurately reconstruct complex flow fields from highly incomplete data (90% missing), even for noisy experimental measurements, with fast training and inference on a single GPU. This work provides a promising new direction for tackling reconstruction problems in fluid mechanics and other areas in mechanics, geophysics, weather prediction, and beyond.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper20
- Energy-Based Transformers are Scalable Learners and ThinkersAlexi Gladstone, Ganesh Nanduru, Md Mofijul Islam, Peixuan Han 等ICLR 2026 · 被引用 38 次
- Guided Diffusion Sampling on Function Spaces with Applications to PDEsJiachen Yao, Abbas Mammadov, Julius Berner, Gavin Kerrigan 等NeurIPS 2025 · 被引用 37 次
- Dense Associative Memory Through the Lens of Random FeaturesBenjamin Hoover, Duen Horng Chau, Hendrik Strobelt, Parikshit Ram 等NeurIPS 2024 · 被引用 18 次
- Sparse and Structured Hopfield NetworksSaul José Rodrigues dos Santos, Vlad Niculae, Daniel C. McNamee, André F. T. MartinsICML 2024 · 被引用 12 次
- Deep sequence models tend to memorize geometrically; it is unclear whyShahriar Noroozizadeh, Vaishnavh Nagarajan, Elan Rosenfeld, Sanjiv KumarICML 2026 · 被引用 11 次
它引用的顶会 Paper2
相关 Paper
- Physics-Informed Diffusion ModelsJan-Hendrik Bastek, WaiChing Sun, Dennis M. KochmannICLR 2025 · 被引用 165 次
- Incomplete Data, Complete Dynamics: A Diffusion ApproachZihan Zhou, Chenguang Wang, Hongyi Ye, Yongtao Guan 等ICLR 2026 · 被引用 3 次
- EAGLE: Large-scale Learning of Turbulent Fluid Dynamics with Mesh TransformersSteeven Janny, Aurélien Béneteau, Madiha Nadri, Julie Digne 等ICLR 2023 · 被引用 5 次
- Physics-enhanced Neural Operator: An Application in Simulating Turbulent TransportShengyu Chen, Peyman Givi, Can Zheng, Xiaowei JiaKDD 2026
- CViT: Continuous Vision Transformer for Operator LearningSifan Wang, Jacob H. Seidman, Shyam Sankaran, Hanwen Wang 等ICLR 2025
