CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction
Suyi Chen, Haibin Ling
摘要
As a critical modality for structural biology, cryogenic electron microscopy (cryo-EM) facilitates the determination of macromolecular structures at near-atomic resolution. The core computational task in single-particle cryo-EM is to reconstruct the 3D electrostatic potential of a molecule from noisy 2D projections acquired at unknown orientations. Gaussian mixture models (GMMs) provide a continuous, compact, and physically interpretable representation for molecular density and have recently gained interest in cryo-EM reconstruction. However, existing methods rely on external consensus maps or atomic models for initialization, limiting their use in self-contained pipelines. In parallel, differentiable rendering techniques such as Gaussian splatting have demonstrated remarkable scalability and efficiency for volumetric representations, suggesting a natural fit for GMM-based cryo-EM reconstruction. However, off-the-shelf Gaussian splatting methods are designed for photorealistic view synthesis and remain incompatible with cryo-EM due to mismatches in the image formation physics, reconstruction objectives, and coordinate systems. Addressing these issues, we propose cryoSplat, a GMM-based method that integrates Gaussian splatting with the physics of cryo-EM image formation. In particular, we develop an orthogonal projection-aware Gaussian splatting, with adaptations such as a view-dependent normalization term and FFT-aligned coordinate system tailored for cryo-EM imaging. These innovations enable stable and efficient homogeneous reconstruction directly from raw cryo-EM particle images using random initialization. Experimental results on real datasets validate the effectiveness and robustness of cryoSplat over representative baselines. The code will be released at https://github.com/Chen-Suyi/cryosplat.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper6
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger 等SIGGRAPH 2024 · 被引用 660 次
- CryoDRGN2: Ab initio neural reconstruction of 3D protein structures from real cryo-EM imagesEllen D. Zhong, Adam Lerer, Joseph H. Davis, Bonnie BergerICCV 2021 · 被引用 77 次
- Amortized Inference for Heterogeneous Reconstruction in Cryo-EMAxel Levy, Gordon Wetzstein, Julien N. P. Martel, Frédéric Poitevin 等NeurIPS 2022 · 被引用 57 次
- Reconstructing Heterogeneous Biomolecules via Hierarchical Gaussian Mixtures and Part DiscoveryShayan Shekarforoush, David B. Lindell, Marcus A. Brubaker, David J. FleetNeurIPS 2025 · 被引用 1 次
相关 Paper
- YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian SplattingBotao Ye, Boqi Chen, Haofei Xu, Daniel Barath 等ICLR 2026 · 被引用 39 次
- Reconstructing continuous distributions of 3D protein structure from cryo-EM imagesEllen D. Zhong, Tristan Bepler, Joseph H. Davis, Bonnie BergerICLR 2020 · 被引用 124 次
- CryoKRAQEN: Kernel-Regularized Annealing for Quantized Embedding Networks in Cryo-EM Heterogeneous ReconstructionWenyuan Gao, Yutan Wu, Xuming HeCVPR 2026
- CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworksJeffrey Gu, Minkyu Jeon, Ambri Ma, Serena Yeung-Levy 等CVPR 2026 · 被引用 1 次
- No Pose at All: Self-Supervised Pose-Free 3D Gaussian Splatting from Sparse ViewsRanran Huang, Krystian MikolajczykICCV 2025 · 被引用 12 次
