Enhancing Close-up Novel View Synthesis via Pseudo-labeling
Jiatong Xia, Libo Sun, Lingqiao Liu
Abstract
Recent methods, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS), have demonstrated remarkable capabilities in novel view synthesis. However, despite their success in producing high-quality images for viewpoints similar to those seen during training, they struggle when generating detailed images from viewpoints that significantly deviate from the training set, particularly in close-up views. The primary challenge stems from the lack of specific training data for close-up views, leading to the inability of current methods to render these views accurately. To address this issue, we introduce a novel pseudo-label-based learning strategy. This approach leverages pseudo-labels derived from existing training data to provide targeted supervision across a wide range of close-up viewpoints. Recognizing the absence of benchmarks for this specific challenge, we also present a new dataset designed to assess the effectiveness of both current and future methods in this area. Our extensive experiments demonstrate the efficacy of our approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 4b4a20a7-5e6f-4101-9f3e-0fa67f877926Cited by top-tier papers1
Ask how each one uses itBuilds on18
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman et al.ICCV 2021 · 2,700 citations
- PlenOctrees for Real-time Rendering of Neural Radiance FieldsAlex Yu, Ruilong Li, Matthew Tancik, Hao Li et al.ICCV 2021 · 1,284 citations
- MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View StereoAnpei Chen, Zexiang Xu, Fuqiang Zhao, Xiaoshuai Zhang et al.ICCV 2021 · 1,024 citations
Related papers
- FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage TrainingRuihong Yin, Vladimir Yugay, Yue Li, Sezer Karaoglu et al.NeurIPS 2024 · 29 citations
- MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the WildDeming Li, Kaiwen Jiang, Yutao Tang, Ravi Ramamoorthi et al.NeurIPS 2025 · 7 citations
- Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View SynthesisRui Peng, Wangze Xu, Luyang Tang, Levio Leo et al.NeurIPS 2024 · 32 citations
- Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View SynthesisLiang Han, Junsheng Zhou, Yu-Shen Liu, Zhizhong HanNeurIPS 2024 · 63 citations
- NexusGS: Sparse View Synthesis with Epipolar Depth Priors in 3D Gaussian SplattingYulong Zheng, Zicheng Jiang, Shengfeng He, Yandu Sun et al.CVPR 2025
