SphericalDreamer: Generating Navigable Immersive 3D Worlds with Panorama Fusion
Antoine Schnepf, Karim Kassab, Flavian Vasile, Andrew Comport
摘要
The generation of immersive and navigable 3D environments is increasingly prevalent with the growing adoption of virtual reality and 3D content. However, recent methods face a fundamental limitation: they cannot produce 3D worlds that simultaneously (i) are navigable over long-range spatial extents and (ii) cover the complete omnidirectional field of view ( horizontally and vertically). To address this challenge, we introduce SphericalDreamer, a method for generating fully immersive and long-range 3D outdoor environments from textual prompts. Our approach is built on the generation of multiple panoramic images, which are subsequently lifted into 3D and fused together while maintaining visual and geometric consistency. SphericalDreamer produces highly detailed, fully immersive 3D environments, while substantially improving scale and navigability compared to prior approaches.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Denoising Diffusion Probabilistic ModelsJonathan Ho, Ajay Jain, Pieter AbbeelNeurIPS 2020 · 被引用 35,902 次
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, Yong Jae LeeNeurIPS 2023 · 被引用 11,349 次
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao 等NeurIPS 2024 · 被引用 2,305 次
- DreamFusion: Text-to-3D using 2D DiffusionBen Poole, Ajay Jain, Jonathan T. Barron, Ben MildenhallICLR 2023 · 被引用 463 次
相关 Paper
- Autoregressive Omni-Aware Outpainting for Open-Vocabulary 360-Degree Image GenerationZhuqiang Lu, Kun Hu, Chaoyue Wang, Lei Bai 等AAAI 2024 · 被引用 35 次
- Dream360: Diverse and Immersive Outdoor Virtual Scene Creation via Transformer-Based 360° Image OutpaintingHao Ai, Zidong Cao, Haonan Lu, Chen Chen 等IEEE VR 2024 · 被引用 12 次
- LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene GenerationShuai Yang, Jing Tan, Mengchen Zhang, Tong Wu 等SIGGRAPH 2025 · 被引用 23 次
- Spherical Image Generation from a Single Image by Considering Scene SymmetryTakayuki Hara, Yusuke Mukuta, Tatsuya HaradaAAAI 2021 · 被引用 22 次
- 4K4DGen: Panoramic 4D Generation at 4K ResolutionRenjie Li, Panwang Pan, Bangbang Yang, Dejia Xu 等ICLR 2025
