Spectral-Geometric Neural Fields for Pose-Free LiDAR View Synthesis
Yinuo Jiang, Jun Cheng, Yiran Wang, Cheng Cheng
Abstract
Neural Radiance Fields (NeRF) have shown remarkable success in image novel view synthesis (NVS), inspiring extensions to LiDAR NVS. However, most methods heavily rely on accurate camera poses for scene reconstruction. The sparsity and textureless nature of LiDAR data also present distinct challenges, leading to geometric holes and discontinuous surfaces. To address these issues, we propose SG-NLF, a pose-free LiDAR NeRF framework that integrates spectral information with geometric consistency. Specifically, we design a hybrid representation based on spectral priors to reconstruct smooth geometry. For pose optimization, we construct a confidence-aware graph based on feature compatibility to achieve global alignment. In addition, an adversarial learning strategy is introduced to enforce cross-frame consistency, thereby enhancing reconstruction quality. Comprehensive experiments demonstrate the effectiveness of our framework, especially in challenging low-frequency scenarios. Compared to previous state-of-the-art methods, SG-NLF improves reconstruction quality and pose accuracy by over 35.8% and 68.8%. Our work can provide a novel perspective for LiDAR view synthesis.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on24
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
- Geometric Transformer for Fast and Robust Point Cloud RegistrationZheng Qin, Hao Yu, Changjian Wang, Yulan Guo et al.CVPR 2022 · 436 citations
- HRegNet: A Hierarchical Network for Large-scale Outdoor LiDAR Point Cloud RegistrationFan Lu, Guang Chen, Yinlong Liu, Lijun Zhang et al.ICCV 2021 · 133 citations
- Neural LiDAR Fields for Novel View SynthesisShengyu Huang, Zan Gojcic, Zian Wang, Francis Williams et al.ICCV 2023 · 80 citations
Related papers
- GeoNLF: Geometry guided Pose-Free Neural LiDAR FieldsWeiyi Xue, Zehan Zheng, Fan Lu, Haiyun Wei et al.NeurIPS 2024 · 11 citations
- STGC-NeRF: Spatial-Temporal Geometric Consistency for LiDAR Neural Radiance Fields in Dynamic ScenesShangshu Yu, Xiaotian Sun, Wen Li, Qingshan Xu et al.AAAI 2025 · 2 citations
- Multimodal LiDAR-Camera Novel View Synthesis with Unified Pose-free Neural FieldsWeiyi Xue, Fan Lu, Yunwei Zhu, Zehan Zheng et al.NeurIPS 2025
- LiDAR4D: Dynamic Neural Fields for Novel Space-Time View LiDAR SynthesisZehan Zheng, Fan Lu, Weiyi Xue, Guang Chen et al.CVPR 2024 · 14 citations
- Learning Geometry Consistent Neural Radiance Fields from Sparse and Unposed ViewsQi Zhang, Chi Huang, Qian Zhang, Nan Li et al.ACM MM 2024 · 4 citations
