CVPR2023

Solving 3D Inverse Problems Using Pre-Trained 2D Diffusion Models

Hyungjin Chung, Dohoon Ryu, Michael T. McCann, Marc Louis Klasky, Jong Chul Ye

Abstract

Figure 1. 3D reconstruction results with DiffusionMBIR. First row: measurement, second row: our method, third row: ground truth. Yellow inset: measurement process. Sparse-view tomography: 8-view measurement, Limited-angle tomography: [0 90] • out of [0 180] • angle measurement, Compressed-sensing MRI: 1D uniform sub-sampling of ×2 acceleration. (In-distribution): test data aligned with training data, (Out-of-distribution): test data vastly different from training data.