Exploiting & Refining Depth Distributions With Triangulation Light Curtains
Yaadhav Raaj, Siddharth Ancha, Robert Tamburo, David Held, Srinivasa G. Narasimhan
Abstract
RMSE: 1.2m RMSE: 0.4m (a) (b) (c) (d) Figure 1: (a) We show how errors in Monocular Depth Estimation are corrected when used in tandem with an Adaptive Sensor such as a Triangulating Light Curtain (Yellow Points and Red lines are Ground Truth). (b) We predict a per-pixel Depth Probability Volume from Monocular RGB and we observe large per-pixel uncertainties (σ = 3m) as seen in the Bird's Eye View / Top-Down Uncertainty Field slice. (c) We actively drive the Light Curtain sensor's Laser to exploit and sense multiple regions along a curve that maximize information gained. (d) We feed these measurements back recursively to get a refined depth estimate, along with a reduction in uncertainty (σ = 1m).
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers3
- Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous DrivingHanjiang Hu, Zuxin Liu, Sharad Chitlangia, Akhil Agnihotri et al.CVPR 2022 · 60 citations
- Holocurtains: Programming Light Curtains via Binary HolographyDorian Chan, Srinivasa G. Narasimhan, Matthew O'TooleCVPR 2022 · 13 citations
- Energy-Efficient Adaptive 3D SensingBrevin Tilmon, Zhanghao Sun, Sanjeev J. Koppal, Yicheng Wu et al.CVPR 2023
Builds on3
- Gated2Depth: Real-Time Dense Lidar From Gated ImagesTobias Gruber, Frank D. Julca-Aguilar, Mario Bijelic, Felix HeideICCV 2019 · 70 citations
- nuScenes: A Multimodal Dataset for Autonomous DrivingHolger Caesar, Varun Bankiti, Alex H. Lang, Sourabh Vora et al.CVPR 2020
- Generating and Exploiting Probabilistic Monocular Depth EstimatesZhihao Xia, Patrick Sullivan, Ayan ChakrabartiCVPR 2020
Related papers
- Agile Depth Sensing Using Triangulation Light CurtainsJoseph R. Bartels, Jian Wang, William Whittaker, Srinivasa G. NarasimhanICCV 2019 · 24 citations
- Adaptive confidence thresholding for monocular depth estimationHyesong Choi, Hunsang Lee, Sunkyung Kim, Sunok Kim et al.ICCV 2021 · 31 citations
- Learning to Fuse Monocular and Multi-view Cues for Multi-frame Depth Estimation in Dynamic ScenesRui Li, Dong Gong, Wei Yin, Hao Chen et al.CVPR 2023
- Self-Supervised Monocular Scene Flow EstimationJunhwa Hur, Stefan RothCVPR 2020
- NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view StereoYi Wei, Shaohui Liu, Yongming Rao, Wang Zhao et al.ICCV 2021 · 286 citations
