Bi3D: Stereo Depth Estimation via Binary Classifications
Abhishek Badki, Alejandro J. Troccoli, Kihwan Kim, Jan Kautz, Pradeep Sen, Orazio Gallo
Abstract
Stereo-based depth estimation is a cornerstone of computer vision, with state-of-the-art methods delivering accurate results in real time. For several applications such as autonomous navigation, however, it may be useful to trade accuracy for lower latency. We present Bi3D, a method that estimates depth via a series of binary classifications. Rather than testing if objects are at a particular depth D, as existing stereo methods do, it classifies them as being closer or farther than D. This property offers a powerful mechanism to balance accuracy and latency. Given a strict time budget, Bi3D can detect objects closer than a given distance in as little as a few milliseconds, or estimate depth with arbitrarily coarse quantization, with complexity linear with the number of quantization levels. Bi3D can also use the allotted quantization levels to get continuous depth, but in a specific depth range. For standard stereo (i.e., continuous depth on the whole range), our method is close to or on par with state-of-the-art, finely tuned stereo methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 66edb879-aaed-49c8-9b43-a7a8a61ccb18Cited by top-tier papers21
- Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with TransformersZhaoshuo Li, Xingtong Liu, Nathan Drenkow, Andy S. Ding et al.ICCV 2021 · 380 citations
- Quadtree Attention for Vision TransformersShitao Tang, Jiahui Zhang, Siyu Zhu, Ping TanICLR 2022 · 194 citations
- MVS2D: Efficient Multiview Stereo via Attention-Driven 2D ConvolutionsZhenpei Yang, Zhile Ren, Qi Shan, Qixing HuangCVPR 2022 · 43 citations
- GEDepth: Ground Embedding for Monocular Depth EstimationXiaodong Yang, Zhuang Ma, Zhiyu Ji, Zhe RenICCV 2023 · 40 citations
- UASNet: Uncertainty Adaptive Sampling Network for Deep Stereo MatchingYamin Mao, Zhihua Liu, Weiming Li, Yuchao Dai et al.ICCV 2021 · 34 citations
Builds on1
Related papers
- Binary TTC: A Temporal Geofence for Autonomous NavigationAbhishek Badki, Orazio Gallo, Jan Kautz, Pradeep SenCVPR 2021
- MobiDepth: real-time depth estimation using on-device dual camerasJinrui Zhang, Huan Yang, Ju Ren, Deyu Zhang et al.MobiCom 2022 · 24 citations
- Pseudo-LiDAR++: Accurate Depth for 3D Object Detection in Autonomous DrivingYurong You, Yan Wang, Wei-Lun Chao, Divyansh Garg et al.ICLR 2020 · 439 citations
- Real-time Stereo-based 3D Object Detection for Streaming PerceptionChangcai Li, Zonghua Gu, Gang Chen, Libo Huang et al.NeurIPS 2024 · 3 citations
- Wasserstein Distances for Stereo Disparity EstimationDivyansh Garg, Yan Wang, Bharath Hariharan, Mark Campbell et al.NeurIPS 2020 · 78 citations
