PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction
Mingzhi Pei, Xu Cao, Xiangyi Wang, Heng Guo, Zhanyu Ma
Abstract
Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 260b3199-c1e9-4e69-8212-bcac5a23547cBuilds on16
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 2,647 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled DataLihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu et al.CVPR 2024 · 847 citations
- DUSt3R: Geometric 3D Vision Made EasyShuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii et al.CVPR 2024 · 302 citations
- NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview ImagesYuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long et al.SIGGRAPH 2023 · 128 citations
Related papers
- Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view ReconstructionQiancheng Fu, Qingshan Xu, Yew Soon Ong, Wenbing TaoNeurIPS 2022 · 336 citations
- Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy ObjectsYue Fan, Ningjing Fan, Ivan Skorokhodov, Oleg Voynov et al.CVPR 2025
- RNb-NeuS: Reflectance and Normal-Based Multi-View 3D ReconstructionBaptiste Brument, Robin Bruneau, Yvain Quéau, Jean Mélou et al.CVPR 2024
- GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray DiffusionLi-Heng Chen, Zi-Xin Zou, Chang Liu, Tianjiao Jing et al.ICCV 2025
- SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy ViewsShi-Sheng Huang, Zi-Xin Zou, Yichi Zhang, Yan-Pei Cao et al.AAAI 2024 · 10 citations
