SpinMeRound: Consistent Multi-View Identity Generation Using Diffusion Models
Stathis Galanakis, Alexandros Lattas, Stylianos Moschoglou, Bernhard Kainz, Stefanos Zafeiriou
摘要
Despite recent progress in diffusion models, generating realistic head portraits from novel viewpoints remains a significant challenge in computer vision. Most current approaches are constrained to limited angular ranges, predominantly focusing on frontal or near-frontal views. Moreover, although the recent emerging large-scale diffusion models have been proven robust in handling 3D scenes, they underperform on facial data, given their complex structure and the uncanny valley pitfalls. In this paper, we propose SpinMeRound, a diffusion-based approach designed to generate consistent and accurate head portraits from novel viewpoints. By leveraging a number of input views alongside an identity embedding, our method effectively synthesizes diverse viewpoints of a subject whilst robustly maintaining its unique identity features. Through experimentation, we showcase our model's generation capabilities in full head synthesis, while beating current state-of-the-art multi-view diffusion models. Project page: spin-me-round.github.io.round.github.io.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper36
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh 等ICML 2021 · 被引用 47,906 次
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- Diffusion Models Beat GANs on Image SynthesisPrafulla Dhariwal, Alexander Quinn NicholNeurIPS 2021 · 被引用 13,211 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
相关 Paper
- DiffPortrait3D: Controllable Diffusion for Zero-Shot Portrait View SynthesisYuming Gu, Hongyi Xu, You Xie, Guoxian Song 等CVPR 2024
- High-Quality Full-Head 3D Avatar Generation from Any Single Portrait ImageYujie Gao, Chencheng Wang, Xianbing Sun, Jiahui Zhan 等AAAI 2026
- GeoDiff4D: Geometry-Aware Diffusion for 4D Head Avatar ReconstructionChao Xu, Xiaochen Zhao, Xiang Deng, Jingxiang Sun 等CVPR 2026
- DiffPortrait360: Consistent Portrait Diffusion for 360 View SynthesisYuming Gu, Phong Tran, Yujian Zheng, Hongyi Xu 等CVPR 2025
- You Only Need One Stage: Novel-View Synthesis from a Single Blind Face ImageTaoyue Wang, Xiang Zhang, Xiaotian Li, Huiyuan Yang 等AAAI 2026
