Coherence as Texture - Passive Textureless 3D Reconstruction by Self-Interference
Wei-Yu Chen, Aswin C. Sankaranarayanan, Anat Levin, Matthew O'Toole
Abstract
Passive depth estimation based on stereo or defocus relies on the presence of the texture on an object to resolve its depth. Hence, recovering the depth of a textureless objectfor example, a large white wall-is not just hard but perhaps even impossible. Or is it? We show that spatial coherence, a property of natural light sources, can be used to resolve the depth of a scene point even when it is textureless. Our approach relies on the idea that natural light scattered off a scene point is locally coherent with itself, while incoherent with the light scattered from other surface points; we use this insight to design an optical setup that uses selfinterference as a texture feature for estimating depth. Our lab prototype is capable of resolving depths of textureless objects in sunlight as well as indoor lights.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 7301d204-4cef-44f5-9719-2597b2a134b6Cited by top-tier papers1
Ask how each one uses itBuilds on3
- Interferometric transmission probing with coded mutual intensityAlankar Kotwal, Anat Levin, Ioannis GkioulekasSIGGRAPH 2020 · 16 citations
- Passive Micron-Scale Time-of-Flight with Sunlight InterferometryAlankar Kotwal, Anat Levin, Ioannis GkioulekasCVPR 2023
- Swept-Angle Synthetic Wavelength InterferometryAlankar Kotwal, Anat Levin, Ioannis GkioulekasCVPR 2023
Related papers
- LightDepth: Single-View Depth Self-Supervision from Illumination DeclineJavier Rodriguez Puigvert, Victor M. Batlle, J. M. M. Montiel, Ruben Martinez-Cantin et al.ICCV 2023 · 22 citations
- Shape from Thermal Radiation: Passive Ranging Using Multi-spectral LWIR MeasurementsYasuto Nagase, Takahiro Kushida, Kenichiro Tanaka, Takuya Funatomi et al.CVPR 2022 · 12 citations
- LightOctree: Lightweight 3D Spatially-Coherent Indoor Lighting EstimationXuecan Wang, Shibang Xiao, Xiaohui LiangCVPR 2024 · 2 citations
- Moving Indoor: Unsupervised Video Depth Learning in Challenging EnvironmentsJunsheng Zhou, Yuwang Wang, Kaihuai Qin, Wenjun ZengICCV 2019 · 74 citations
- Deep 3D Capture: Geometry and Reflectance From Sparse Multi-View ImagesSai Bi, Zexiang Xu, Kalyan Sunkavalli, David J. Kriegman et al.CVPR 2020
