Solving 3D Inverse Problems Using Pre-Trained 2D Diffusion Models
Hyungjin Chung, Dohoon Ryu, Michael T. McCann, Marc Louis Klasky, Jong Chul Ye
Abstract
Figure 1. 3D reconstruction results with DiffusionMBIR. First row: measurement, second row: our method, third row: ground truth. Yellow inset: measurement process. Sparse-view tomography: 8-view measurement, Limited-angle tomography: [0 90] • out of [0 180] • angle measurement, Compressed-sensing MRI: 1D uniform sub-sampling of ×2 acceleration. (In-distribution): test data aligned with training data, (Out-of-distribution): test data vastly different from training data.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
31 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- High-Resolution Image Synthesis with Latent Diffusion Models cites Diffusion Models Beat GANs on Image Synthesis
- High-Resolution Image Synthesis with Latent Diffusion Models cites Denoising Diffusion Probabilistic Models
- High-Resolution Image Synthesis with Latent Diffusion Models cites Score-Based Generative Modeling through Stochastic Differential Equations
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models cites High-Resolution Image Synthesis with Latent Diffusion Models
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models cites Diffusion Models Beat GANs on Image Synthesis
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models cites Denoising Diffusion Restoration Models
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models cites Denoising Diffusion Probabilistic Models
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models cites Score-Based Generative Modeling through Stochastic Differential Equations
- A Variational Perspective on Solving Inverse Problems with Diffusion Models cites High-Resolution Image Synthesis with Latent Diffusion Models
- A Variational Perspective on Solving Inverse Problems with Diffusion Models cites Diffusion Models Beat GANs on Image Synthesis
- A Variational Perspective on Solving Inverse Problems with Diffusion Models cites Denoising Diffusion Restoration Models
- A Variational Perspective on Solving Inverse Problems with Diffusion Models cites Score-Based Generative Modeling through Stochastic Differential Equations
- R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction cites Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion Models
- Diffusion Models Beat GANs on Image Synthesis cites Denoising Diffusion Probabilistic Models
- Diffusion Models Beat GANs on Image Synthesis cites Score-Based Generative Modeling through Stochastic Differential Equations
- Denoising Diffusion Restoration Models cites Diffusion Models Beat GANs on Image Synthesis
- Denoising Diffusion Restoration Models cites Denoising Diffusion Probabilistic Models
- Denoising Diffusion Restoration Models cites Score-Based Generative Modeling through Stochastic Differential Equations
- Direct Diffusion Bridge using Data Consistency for Inverse Problems cites High-Resolution Image Synthesis with Latent Diffusion Models
- Direct Diffusion Bridge using Data Consistency for Inverse Problems cites Diffusion Models Beat GANs on Image Synthesis
- Direct Diffusion Bridge using Data Consistency for Inverse Problems cites Denoising Diffusion Restoration Models
- Direct Diffusion Bridge using Data Consistency for Inverse Problems cites Denoising Diffusion Probabilistic Models
- Direct Diffusion Bridge using Data Consistency for Inverse Problems cites Score-Based Generative Modeling through Stochastic Differential Equations
- Score-Based Generative Modeling through Stochastic Differential Equations cites Denoising Diffusion Probabilistic Models
- Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems cites Diffusion Models Beat GANs on Image Synthesis
- Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems cites Denoising Diffusion Restoration Models
- Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems cites Denoising Diffusion Probabilistic Models
- Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problems cites Score-Based Generative Modeling through Stochastic Differential Equations
Cited by top-tier papers31
- A Variational Perspective on Solving Inverse Problems with Diffusion ModelsMorteza Mardani, Jiaming Song, Jan Kautz, Arash VahdatICLR 2024 · 240 citations
- Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse ProblemsHyungjin Chung, Suhyeon Lee, Jong Chul YeICLR 2024 · 142 citations
- R2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic ReconstructionRuyi Zha, Tao Jun Lin, Yuanhao Cai, Jiwen Cao et al.NeurIPS 2024 · 99 citations
- Direct Diffusion Bridge using Data Consistency for Inverse ProblemsHyungjin Chung, Jeongsol Kim, Jong Chul YeNeurIPS 2023 · 86 citations
- Improving 3D Imaging with Pre-Trained Perpendicular 2D Diffusion ModelsSuhyeon Lee, Hyungjin Chung, Minyoung Park, Jonghyuk Park et al.ICCV 2023 · 72 citations
Builds on15
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Restoration ModelsBahjat Kawar, Michael Elad, Stefano Ermon, Jiaming SongNeurIPS 2022 · 1,439 citations
- Score-Based Generative Modeling through Stochastic Differential EquationsYang Song, Jascha Sohl-Dickstein, Diederik P. Kingma, Abhishek Kumar et al.ICLR 2021 · 1,270 citations
Related papers
- SIR-DIFF: Sparse Image Sets Restoration with Multi-View Diffusion ModelYucheng Mao, Boyang Wang, Nilesh Kulkarni, Jeong Joon ParkCVPR 2025
- DiffusionBlend: Learning 3D Image Prior through Position-aware Diffusion Score Blending for 3D Computed Tomography ReconstructionBowen Song, Jason Hu, Zhaoxu Luo, Jeffrey A. Fessler et al.NeurIPS 2024 · 20 citations
- Inverse Rendering for Discrete X-Ray Computed TomographyLovro Nuic, Ziyi Zhang, Korbinian Sager, Wenzel JakobSIGGRAPH 2026
- DM4CT: Benchmarking Diffusion Models for Computed Tomography ReconstructionJiayang Shi, Daniël Maria Pelt, Kees Joost BatenburgICLR 2026 · 5 citations
- GTR: Improving Large 3D Reconstruction Models through Geometry and Texture RefinementPeiye Zhuang, Songfang Han, Chaoyang Wang, Aliaksandr Siarohin et al.ICLR 2025
