PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface Reconstruction
Mingzhi Pei, Xu Cao, Xiangyi Wang, Heng Guo, Zhanyu Ma
摘要
Reflective and textureless surfaces remain a challenge in multi-view 3D reconstruction. Both camera pose calibration and shape reconstruction often fail due to insufficient or unreliable cross-view visual features. To address these issues, we present PMNI (Pose-free Multi-view Normal Integration), a neural surface reconstruction method that incorporates rich geometric information by leveraging surface normal maps instead of RGB images. By enforcing geometric constraints from surface normals and multi-view shape consistency within a neural signed distance function (SDF) optimization framework, PMNI simultaneously recovers accurate camera poses and high-fidelity surface geometry. Experimental results on synthetic and real-world datasets show that our method achieves state-of-the-art performance in the reconstruction of reflective surfaces, even without reliable initial camera poses.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 被引用 2,647 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled DataLihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu 等CVPR 2024 · 被引用 847 次
- DUSt3R: Geometric 3D Vision Made EasyShuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii 等CVPR 2024 · 被引用 302 次
- NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview ImagesYuan Liu, Peng Wang, Cheng Lin, Xiaoxiao Long 等SIGGRAPH 2023 · 被引用 128 次
相关 Paper
- Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view ReconstructionQiancheng Fu, Qingshan Xu, Yew Soon Ong, Wenbing TaoNeurIPS 2022 · 被引用 336 次
- Factored-NeuS: Reconstructing Surfaces, Illumination, and Materials of Possibly Glossy ObjectsYue Fan, Ningjing Fan, Ivan Skorokhodov, Oleg Voynov 等CVPR 2025
- RNb-NeuS: Reflectance and Normal-Based Multi-View 3D ReconstructionBaptiste Brument, Robin Bruneau, Yvain Quéau, Jean Mélou 等CVPR 2024
- GCRayDiffusion: Pose-Free Surface Reconstruction via Geometric Consistent Ray DiffusionLi-Heng Chen, Zi-Xin Zou, Chang Liu, Tianjiao Jing 等ICCV 2025
- SC-NeuS: Consistent Neural Surface Reconstruction from Sparse and Noisy ViewsShi-Sheng Huang, Zi-Xin Zou, Yichi Zhang, Yan-Pei Cao 等AAAI 2024 · 被引用 10 次
