CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks
Jeffrey Gu, Minkyu Jeon, Ambri Ma, Serena Yeung-Levy, Ellen D. Zhong
Abstract
Cryo-electron microscopy (cryo-EM) is an indispensable technique for determining the 3D structures of dynamic biomolecular complexes. While typically applied to image a single molecular species, cryo-EM has the potential for structure determination of many targets simultaneously in a high-throughput fashion. However, existing methods typically focus on modeling conformational heterogeneity within a single or a few structures and are not designed to resolve compositional heterogeneity arising from mixtures of many distinct molecular species. To address this challenge, we propose CryoHype, a transformer-based hypernetwork for cryo-EM reconstruction that dynamically adjusts the weights of an implicit neural representation. Using CryoHype, we achieve state-of-the-art results on a challenging benchmark dataset containing 100 structures. We further demonstrate that CryoHype scales to the reconstruction of 1,000 distinct structures from unlabeled cryo-EM images in the fixed-pose setting. Project page: https: //cryohype.cs.princeton.edu/.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 983731c7-035a-4632-80ae-4cf75b2171c7Builds on18
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Implicit Neural Representations with Periodic Activation FunctionsVincent Sitzmann, Julien N. P. Martel, Alexander W. Bergman, David B. Lindell et al.NeurIPS 2020 · 4,008 citations
- Light Field Networks: Neural Scene Representations with Single-Evaluation RenderingVincent Sitzmann, Semon Rezchikov, Bill Freeman, Josh Tenenbaum et al.NeurIPS 2021 · 426 citations
- MetaSDF: Meta-Learning Signed Distance FunctionsVincent Sitzmann, Eric R. Chan, Richard Tucker, Noah Snavely et al.NeurIPS 2020 · 302 citations
- Modulated Periodic Activations for Generalizable Local Functional RepresentationsIshit Mehta, Michaël Gharbi, Connelly Barnes, Eli Shechtman et al.ICCV 2021 · 188 citations
Related papers
- Mixture of neural fields for heterogeneous reconstruction in cryo-EMAxel Levy, Rishwanth Raghu, David Shustin, Adele Rui-Yang Peng et al.NeurIPS 2024 · 5 citations
- CryoDRGN2: Ab initio neural reconstruction of 3D protein structures from real cryo-EM imagesEllen D. Zhong, Adam Lerer, Joseph H. Davis, Bonnie BergerICCV 2021 · 77 citations
- Reconstructing continuous distributions of 3D protein structure from cryo-EM imagesEllen D. Zhong, Tristan Bepler, Joseph H. Davis, Bonnie BergerICLR 2020 · 124 citations
- Amortized Inference for Heterogeneous Reconstruction in Cryo-EMAxel Levy, Gordon Wetzstein, Julien N. P. Martel, Frédéric Poitevin et al.NeurIPS 2022 · 57 citations
- CryoKRAQEN: Kernel-Regularized Annealing for Quantized Embedding Networks in Cryo-EM Heterogeneous ReconstructionWenyuan Gao, Yutan Wu, Xuming HeCVPR 2026
