HiNeuS: High-Fidelity Neural Surface Mitigating Low-Texture and Reflective Ambiguity
Yida Wang, Xueyang Zhang, Kun Zhan, Peng Jia, Xianpeng Lang
摘要
Neural surface reconstruction faces persistent challenges in reconciling geometric fidelity with photometric consistency under complex scene conditions. We present HiNeuS, a unified framework that holistically addresses three core limitations in existing approaches: multi-view radiance inconsistency, missing keypoints in textureless regions, and structural degradation from over-enforced Eikonal constraints during joint optimization. To resolve these issues through a unified pipeline, we introduce: 1) Differential visibility verification through SDF-guided ray tracing, resolving reflection ambiguities via continuous occlusion modeling; 2) Planar-conformal regularization via ray-aligned geometry patches that enforce local surface coherence while preserving sharp edges through adaptive appearance weighting; and 3) Physically-grounded Eikonal relaxation that dynamically modulates geometric constraints based on local radiance gradients, enabling detail preservation without sacrificing global regularity. Unlike prior methods that handle these aspects through sequential optimizations or isolated modules, our approach achieves cohesive integration where appearance-geometry constraints evolve synergistically throughout training. Comprehensive evaluations across synthetic and real-world datasets demonstrate state-of-the-art performance, including a 21.4% reduction in Chamfer distance over reflection-aware baselines and 2.32 dB PSNR improvement against neural rendering counterparts. Qualitative analyses reveal superior capability in recovering specular instruments, urban layouts with centimeter-scale infrastructure, and low-textured surfaces without local patch collapse. The method's generalizability is further validated through successful application to inverse rendering tasks, including material decomposition and view-consistent relighting.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper1
问问它们各自怎么用它它引用的顶会 Paper19
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 被引用 5,687 次
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 被引用 4,089 次
- Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman 等ICCV 2021 · 被引用 2,700 次
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt 等NeurIPS 2021 · 被引用 2,500 次
- Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance FieldsJonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan 等CVPR 2022 · 被引用 1,603 次
相关 Paper
- ENVIDR: Implicit Differentiable Renderer with Neural Environment LightingRuofan Liang, Huiting Chen, Chunlin Li, Fan Chen 等ICCV 2023 · 被引用 72 次
- IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric ImagesKai Zhang, Fujun Luan, Zhengqi Li, Noah SnavelyCVPR 2022 · 被引用 85 次
- Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view ReconstructionQiancheng Fu, Qingshan Xu, Yew Soon Ong, Wenbing TaoNeurIPS 2022 · 被引用 336 次
- NeFII: Inverse Rendering for Reflectance Decomposition with Near-Field Indirect IlluminationHaoqian Wu, Zhipeng Hu, Lincheng Li, Yongqiang Zhang 等CVPR 2023
- Looking Through the Glass: Neural Surface Reconstruction Against High Specular ReflectionsJiaxiong Qiu, Peng-Tao Jiang, Yifan Zhu, Ze-Xin Yin 等CVPR 2023
