Seeing A 3D World in A Grain of Sand
Yufan Zhang, Yu Ji, Yu Guo, Jinwei Ye
Abstract
We present a snapshot imaging technique for recovering 3D surrounding views of miniature scenes. Due to their intricacy, miniature scenes with objects sized in millimeters are difficult to reconstruct, yet miniatures are common in life and their 3D digitalization is desirable. We design a catadioptric imaging system with a single camera and eight pairs of planar mirrors for snapshot 3D reconstruction from a dollhouse perspective. We place paired mirrors on nested pyramid surfaces for capturing surrounding multi-view images in a single shot. Our mirror design is customizable based on the size of the scene for optimized view coverage. We use the 3D Gaussian Splatting (3DGS) representation for scene reconstruction and novel view synthesis. We overcome the challenge posed by our sparse view input by integrating visual hull-derived depth constraint. Our method demonstrates state-of-the-art performance on a variety of synthetic and real miniature scenes.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content CreationJiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu et al.ICLR 2024 · 955 citations
- A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large DatasetsBernhard Kerbl, Andreas Meuleman, Georgios Kopanas, Michael Wimmer et al.SIGGRAPH 2024 · 180 citations
- DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving ScenesXiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang et al.CVPR 2024 · 166 citations
- ReconFusion: 3D Reconstruction with Diffusion PriorsRundi Wu, Ben Mildenhall, Philipp Henzler, Keunhong Park et al.CVPR 2024 · 137 citations
Related papers
- GigaGS: 3D Gaussian Based Planar Representation for Large-Scene Surface ReconstructionJunyi Chen, Weicai Ye, Yifan Wang, Danpeng Chen et al.AAAI 2025 · 5 citations
- GS-2DGS: Geometrically Supervised 2DGS for Reflective Object ReconstructionJinguang Tong, Xuesong Li, Fahira Afzal Maken, Sundaram Muthu et al.CVPR 2025
- Gaussian Splatting SLAMHidenobu Matsuki, Riku Murai, Paul H. J. Kelly, Andrew J. DavisonCVPR 2024 · 328 citations
- Motion Decoupled 3D Gaussian Splatting for Dynamic Object RepresentationXiao Hu, Libo Long, Jochen LangAAAI 2025 · 2 citations
- SurfaceSplat: Connecting Surface Reconstruction and Gaussian SplattingZihui Gao, Jia-Wang Bian, Guosheng Lin, Hao Chen et al.ICCV 2025 · 1 citation
