CryoLVM: Self-supervised Learning from Cryo-EM Density Maps with Large Vision Models
Weining Fu, Kai Shu, Kui Xu, Qiangfeng Cliff Zhang
Abstract
Cryo-electron microscopy (cryo-EM) has revolutionized structural biology by enabling near-atomic-level visualization of biomolecular assemblies. However, the exponential growth in cryo-EM data throughput and complexity, coupled with diverse downstream analytical tasks, necessitates unified computational frameworks that transcend current task-specific deep learning approaches with limited scalability and generalizability. We present CryoLVM, a foundation model that learns rich structural representations from experimental density maps with resolved structures by leveraging the Joint-Embedding Predictive Architecture (JEPA) integrated with SCUNet-based backbone, which can be rapidly adapted to various downstream tasks. We further introduce a novel histogram-based distribution alignment loss that accelerates convergence and enhances fine-tuning performance. We demonstrate CryoLVM's effectiveness across three critical cryo-EM tasks: density map sharpening, density map super-resolution, and missing wedge restoration. Our method consistently outperforms state-of-the-art baselines across multiple density map quality metrics, confirming its potential as a versatile model for a wide spectrum of cryo-EM applications.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 19bc2608-ab1d-4629-8c84-0d02b0cd0973Builds on6
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- A ConvNet for the 2020sZhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer et al.CVPR 2022 · 6,782 citations
- Brain-JEPA: Brain Dynamics Foundation Model with Gradient Positioning and Spatiotemporal MaskingZijian Dong, Ruilin Li, Yilei Wu, Thuan Tinh Nguyen et al.NeurIPS 2024 · 96 citations
- CryoFastAR: Fast Cryo-EM AB Initio Reconstruction Made EasyJiakai Zhang, Shouchen Zhou, Haizhao Dai, Xinhang Liu et al.ICCV 2025 · 2 citations
- CryoDomain: Sequence-free Protein Domain Identification from Low-resolution Cryo-EM Density MapsMuzhi Dai, Zhuoer Dong, Weining Fu, Kui Xu et al.AAAI 2025 · 1 citation
Related papers
- CryoFM: A Flow-based Foundation Model for Cryo-EM DensitiesYi Zhou, Yilai Li, Jing Yuan, Quanquan GuICLR 2025
- A Supervised Multi-task Framework for Joint cryo-ET Restoration Enabled by Generative Physical SimulationXinsheng Wang, Zhidong Yang, Xiaohua Wan, Renmin Han et al.CVPR 2026
- End-to-end robust joint unsupervised image alignment and clusteringXiangrui Zeng, Gregory Howe, Min XuICCV 2021 · 12 citations
- CryoNet.Refine: A One-step Diffusion Model for Rapid Refinement of Structural Models with Cryo-EM Density Map RestraintsFuyao Huang, Xiaozhu Yu, Kui Xu, Qiangfeng Cliff ZhangICLR 2026 · 3 citations
- CryoGEN: Generative Energy-based Models for Cryogenic Electron Tomography ReconstructionYunfei Teng, Yuxuan Ren, Kai Chen, Xi Chen et al.ICLR 2025
