RealFusion 360° Reconstruction of Any Object from a Single Image

https://lukemelas.github.io/realfusion Figure 1. RealFusion generates a full 360 • reconstruction of any object given a single image of it (left column). It does so by leveraging an existing diffusion-based 2D image generator. From the given image, it synthesizes a prompt that causes the diffusion model to "dream up" other views of the object. It then extracts a neural radiance field from the original image and the diffusion model-based prior, thereby reconstructing the object in full. Both appearance and geometry are reconstructed faithfully and extrapolated in a plausible manner.