On the Uncertainty of Self-Supervised Monocular Depth Estimation
Matteo Poggi, Filippo Aleotti, Fabio Tosi, Stefano Mattoccia
Abstract
Self-supervised paradigms for monocular depth estimation are very appealing since they do not require ground truth annotations at all. Despite the astonishing results yielded by such methodologies, learning to reason about the uncertainty of the estimated depth maps is of paramount importance for practical applications, yet uncharted in the literature. Purposely, we explore for the first time how to estimate the uncertainty for this task and how this affects depth accuracy, proposing a novel peculiar technique specifically designed for self-supervised approaches. On the standard KITTI dataset, we exhaustively assess the performance of each method with different self-supervised paradigms. Such evaluation highlights that our proposal i) always improves depth accuracy significantly and ii) yields state-of-the-art results concerning uncertainty estimation when training on sequences and competitive results uniquely deploying stereo pairs.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers58
- Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal EstimationGwangbin Bae, Ignas Budvytis, Roberto CipollaICCV 2021 · 154 citations
- Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth EstimationHyunyoung Jung, Eunhyeok Park, Sungjoo YooICCV 2021 · 133 citations
- Robust Monocular Depth Estimation under Challenging ConditionsStefano Gasperini, Nils Morbitzer, HyunJun Jung, Nassir Navab et al.ICCV 2023 · 87 citations
- Toward Practical Monocular Indoor Depth EstimationCho-Ying Wu, Jialiang Wang, Michael Hall, Ulrich Neumann et al.CVPR 2022 · 68 citations
- Self-supervised Monocular Depth Estimation: Let's Talk About The WeatherKieran Saunders, George Vogiatzis, Luis J. MansoICCV 2023 · 64 citations
Builds on4
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Self-Supervised Monocular Depth HintsJamie Watson, Michael Firman, Gabriel J. Brostow, Daniyar TurmukhambetovICCV 2019 · 287 citations
- Self-Supervised Learning With Geometric Constraints in Monocular Video: Connecting Flow, Depth, and CameraYuhua Chen, Cordelia Schmid, Cristian SminchisescuICCV 2019 · 265 citations
- Distilled Semantics for Comprehensive Scene Understanding from VideosFabio Tosi, Filippo Aleotti, Pierluigi Zama Ramirez, Matteo Poggi et al.CVPR 2020
Related papers
- Self-Supervised Monocular Trained Depth Estimation Using Self-Attention and Discrete Disparity VolumeAdrian Johnston, Gustavo CarneiroCVPR 2020
- The Edge of Depth: Explicit Constraints Between Segmentation and DepthShengjie Zhu, Garrick Brazil, Xiaoming LiuCVPR 2020
- D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual OdometryNan Yang, Lukas von Stumberg, Rui Wang, Daniel CremersCVPR 2020
- Adaptive confidence thresholding for monocular depth estimationHyesong Choi, Hunsang Lee, Sunkyung Kim, Sunok Kim et al.ICCV 2021 · 31 citations
- The Temporal Opportunist: Self-Supervised Multi-Frame Monocular DepthJamie Watson, Oisin Mac Aodha, Victor Prisacariu, Gabriel J. Brostow et al.CVPR 2021
