Amortized Inference for Heterogeneous Reconstruction in Cryo-EM
Axel Levy, Gordon Wetzstein, Julien N. P. Martel, Frédéric Poitevin, Ellen D. Zhong
Abstract
Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved. Our method, cryoFIRE, performs ab initio heterogeneous reconstruction with unknown poses in an amortized framework, thereby avoiding the computationally expensive step of pose search while enabling the analysis of conformational heterogeneity. Poses and conformation are jointly estimated by an encoder while a physics-based decoder aggregates the images into an implicit neural representation of the conformational space. We show that our method can provide one order of magnitude speedup on datasets containing millions of images without any loss of accuracy. We validate that the joint estimation of poses and conformations can be amortized over the size of the dataset. For the first time, we prove that an amortized method can extract interpretable dynamic information from experimental datasets.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext c1e2000d-90c0-49d6-814f-8329e59cb98cCited by top-tier papers7
- CryoGEM: Physics-Informed Generative Cryo-Electron MicroscopyJiakai Zhang, Qihe Chen, Yan Zeng, Wenyuan Gao et al.NeurIPS 2024 · 6 citations
- Mixture of neural fields for heterogeneous reconstruction in cryo-EMAxel Levy, Rishwanth Raghu, David Shustin, Adele Rui-Yang Peng et al.NeurIPS 2024 · 5 citations
- Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy MoviesEnze Ye, Yuhang Wang, Hong Zhang, Yiqin Gao et al.ICCV 2023 · 4 citations
- CryoFastAR: Fast Cryo-EM AB Initio Reconstruction Made EasyJiakai Zhang, Shouchen Zhou, Haizhao Dai, Xinhang Liu et al.ICCV 2025 · 2 citations
- Reconstructing Heterogeneous Biomolecules via Hierarchical Gaussian Mixtures and Part DiscoveryShayan Shekarforoush, David B. Lindell, Marcus A. Brubaker, David J. FleetNeurIPS 2025 · 1 citation
Builds on4
- Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional DomainsMatthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil et al.NeurIPS 2020 · 4,036 citations
- Reconstructing continuous distributions of 3D protein structure from cryo-EM imagesEllen D. Zhong, Tristan Bepler, Joseph H. Davis, Bonnie BergerICLR 2020 · 124 citations
- CryoDRGN2: Ab initio neural reconstruction of 3D protein structures from real cryo-EM imagesEllen D. Zhong, Adam Lerer, Joseph H. Davis, Bonnie BergerICCV 2021 · 77 citations
- Harmony: A Generic Unsupervised Approach for Disentangling Semantic Content from Parameterized TransformationsMostofa Rafid Uddin, Gregory Howe, Xiangrui Zeng, Min XuCVPR 2022 · 9 citations
Related papers
- CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworksJeffrey Gu, Minkyu Jeon, Ambri Ma, Serena Yeung-Levy et al.CVPR 2026 · 1 citation
- CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose InferenceShayan Shekarforoush, David B. Lindell, Marcus A. Brubaker, David J. FleetNeurIPS 2024
- CryoKRAQEN: Kernel-Regularized Annealing for Quantized Embedding Networks in Cryo-EM Heterogeneous ReconstructionWenyuan Gao, Yutan Wu, Xuming HeCVPR 2026
- CryoACE: An Atom-centric Framework for Accurate and Automated Model Building in Cryo-EMMinzhang Li, Mingrui Li, Weichen Qin, Qihe Chen et al.ICML 2026
- Sparse Fourier Backpropagation in Cryo-EM ReconstructionDari Kimanius, Kiarash Jamali, Sjors H. W. ScheresNeurIPS 2022 · 10 citations
