From Transparent to Opaque: Rethinking Neural Implicit Surfaces with -NeuS
Haoran Zhang, Junkai Deng, Xuhui Chen, Fei Hou, Wencheng Wang, Hong Qin, Chen Qian, Ying He
Abstract
Traditional 3D shape reconstruction techniques from multi-view images, such as structure from motion and multi-view stereo, face challenges in reconstructing transparent objects. Recent advances in neural radiance fields and its variants primarily address opaque or transparent objects, encountering difficulties to reconstruct both transparent and opaque objects simultaneously. This paper introduces α-NeuS-an extension of NeuS-that proves NeuS is unbiased for materials from fully transparent to fully opaque. We find that transparent and opaque surfaces align with the non-negative local minima and the zero iso-surface, respectively, in the learned distance field of NeuS. Traditional iso-surfacing extraction algorithms, such as marching cubes, which rely on fixed iso-values, are ill-suited for such data. We develop a method to extract the transparent and opaque surface simultaneously based on DCUDF. To validate our approach, we construct a benchmark that includes both real-world and synthetic scenes, demonstrating its practical utility and effectiveness. Our data and code are publicly available at https://github.com/728388808/alpha-NeuS .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
- Opti-NeuS: Neural Reconstruction for Dual-Layered Transparent and Opaque Objects cites NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
- Opti-NeuS: Neural Reconstruction for Dual-Layered Transparent and Opaque Objects cites 3D Gaussian Splatting for Real-Time Radiance Field Rendering
- 2D Gaussian Splatting for Geometrically Accurate Radiance Fields cites NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction
- 2D Gaussian Splatting for Geometrically Accurate Radiance Fields cites Volume Rendering of Neural Implicit Surfaces
- 2D Gaussian Splatting for Geometrically Accurate Radiance Fields cites Plenoxels: Radiance Fields without Neural Networks
- 3D Gaussian Splatting for Real-Time Radiance Field Rendering cites Plenoxels: Radiance Fields without Neural Networks
Cited by top-tier papers1
Builds on21
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Plenoxels: Radiance Fields without Neural NetworksSara Fridovich-Keil, Alex Yu, Matthew Tancik, Qinhong Chen et al.CVPR 2022 · 1,237 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
Related papers
- Seeing Through the Glass: Neural 3D Reconstruction of Object Inside a Transparent ContainerJinguang Tong, Sundaram Muthu, Fahira Afzal Maken, Chuong Nguyen et al.CVPR 2023
- NLOS-NeuS: Non-line-of-sight Neural Implicit SurfaceYuki Fujimura, Takahiro Kushida, Takuya Funatomi, Yasuhiro MukaigawaICCV 2023 · 21 citations
- NeuralTO: Neural Reconstruction and View Synthesis of Translucent ObjectsYuxiang Cai, Jiaxiong Qiu, Zhong Li, Bo RenSIGGRAPH 2024 · 6 citations
- 2S-UDF: A Novel Two-Stage UDF Learning Method for Robust Non-Watertight Model Reconstruction from Multi-View ImagesJunkai Deng, Fei Hou, Xuhui Chen, Wencheng Wang et al.CVPR 2024
- Ref-NeuS: Ambiguity-Reduced Neural Implicit Surface Learning for Multi-View Reconstruction with ReflectionWenhang Ge, Tao Hu, Haoyu Zhao, Shu Liu et al.ICCV 2023 · 79 citations
