Consistent View Synthesis with Pose-Guided Diffusion Models
Hung-Yu Tseng, Qinbo Li, Changil Kim, Suhib Alsisan, Jia-Bin Huang, Johannes Kopf
2023Year
63Top-tier citations
Abstract
https://poseguided-diffusion.github.io/ Outputs Input Figure 1. Consistent view synthesis via pose-guided diffusion model. (top) Given an input image and a sequence of camera poses, we present a pose-guided diffusion model to generate a sequence of frames that are photorealistic and 3D consistent. (bottom) Our proposed method can synthesize diverse sequences from the same set of inputs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers63
- SyncDreamer: Generating Multiview-consistent Images from a Single-view ImageYuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long et al.ICLR 2024 · 685 citations
- Wonder3D: Single Image to 3D Using Cross-Domain DiffusionXiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu et al.CVPR 2024 · 269 citations
- MagicDrive: Street View Generation with Diverse 3D Geometry ControlRuiyuan Gao, Kai Chen, Enze Xie, Lanqing Hong et al.ICLR 2024 · 248 citations
- SceneScape: Text-Driven Consistent Scene GenerationRafail Fridman, Amit Abecasis, Yoni Kasten, Tali DekelNeurIPS 2023 · 196 citations
- ReconFusion: 3D Reconstruction with Diffusion PriorsRundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park et al.CVPR 2024 · 137 citations
Builds on36
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 35,902 citations
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsZe Liu, Yutong Lin, Yue Cao, Han Hu et al.ICCV 2021 · 31,683 citations
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 13,211 citations
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser et al.CVPR 2022 · 13,123 citations
- Denoising Diffusion Implicit ModelsJiaming Song, Chenlin Meng, Stefano ErmonICLR 2021 · 11,743 citations
Related papers
- ViVid-1-to-3: Novel View Synthesis with Video Diffusion ModelsJeong-gi Kwak, Erqun Dong, Yuhe Jin, Hanseok Ko et al.CVPR 2024
- ViewDiff: 3D-Consistent Image Generation with Text-to-Image ModelsLukas Höllein, Aljaz Bozic, Norman Müller, David Novotný et al.CVPR 2024
- MultiDiff: Consistent Novel View Synthesis from a Single ImageNorman Müller, Katja Schwarz, Barbara Rössle, Lorenzo Porzi et al.CVPR 2024 · 14 citations
- Morphable Diffusion: 3D-Consistent Diffusion for Single-image Avatar CreationXiyi Chen, Marko Mihajlovic, Shaofei Wang, Sergey Prokudin et al.CVPR 2024
- Long-Term Photometric Consistent Novel View Synthesis with Diffusion ModelsJason J. Yu, Fereshteh Forghani, Konstantinos G. Derpanis, Marcus A. BrubakerICCV 2023 · 71 citations
