Neural Field-Based 3D Surface Reconstruction of Microstructures from Multi-Detector Signals in Scanning Electron Microscopy
Shuo Chen, Yijin Li, Xi Zheng, Guofeng Zhang
Abstract
The 3D characterization of microstructures is crucial for understanding and designing functional materials. However, the scanning electron microscope (SEM), widely used in scientific research, captures only 2D electron intensity distributions. Existing SEM 3D reconstruction methods struggle with textureless regions, shadowing artifacts, and calibration dependencies, whereas advanced learning-based approaches fail to generalize to microscopic SEM domains due to the lack of physical priors and domain-specific data. To address these challenges, we introduce NFH-SEM, a neural field-based hybrid reconstruction framework that recovers high-fidelity 3D surfaces from multi-view, multi-detector SEM images. NFH-SEM integrates coarse multi-view geometry with photometric stereo cues from detector signals through a continuous neural field, incorporating a learnable forward model that embeds SEM imaging physics for self-calibrated, shadow-robust reconstruction. NFH-SEM achieves precise recovery across diverse specimens, revealing 478 nm layered features in two-photon lithography samples, 782 nm surface textures on pollen grains, and 1.559 μm fracture steps on silicon carbide particles, demonstrating its accuracy and broad applicability.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on20
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Instant neural graphics primitives with a multiresolution hash encodingThomas Müller, Alex Evans, Christoph Schied, Alexander KellerSIGGRAPH 2022 · 4,089 citations
- NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view ReconstructionPeng Wang, Lingjie Liu, Yuan Liu, Christian Theobalt et al.NeurIPS 2021 · 2,500 citations
- Volume Rendering of Neural Implicit SurfacesLior Yariv, Jiatao Gu, Yoni Kasten, Yaron LipmanNeurIPS 2021 · 1,421 citations
- Implicit Geometric Regularization for Learning ShapesAmos Gropp, Lior Yariv, Niv Haim, Matan Atzmon et al.ICML 2020 · 1,001 citations
Related papers
- NeuralPlane: Structured 3D Reconstruction in Planar Primitives with Neural FieldsHanqiao Ye, Yuzhou Liu, Yangdong Liu, Shuhan ShenICLR 2025
- S3-NeRF: Neural Reflectance Field from Shading and Shadow under a Single ViewpointWenqi Yang, Guanying Chen, Chaofeng Chen, Zhenfang Chen et al.NeurIPS 2022 · 48 citations
- PMNI: Pose-free Multi-view Normal Integration for Reflective and Textureless Surface ReconstructionMingzhi Pei, Xu Cao, Xiangyi Wang, Heng Guo et al.CVPR 2025
- 3D Gaussian Flats: Hybrid 2D/3D Photometric Scene ReconstructionMaria Taktasheva, Lily Goli, Alessandro Fiorini, Zhen Li et al.NeurIPS 2025 · 3 citations
- Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view ReconstructionQiancheng Fu, Qingshan Xu, Yew Soon Ong, Wenbing TaoNeurIPS 2022 · 336 citations
