Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation
Rui Peng, Ronggang Wang, Yawen Lai, Luyang Tang, Yangang Cai
Abstract
Self-supervised methods play an increasingly important role in monocular depth estimation due to their great potential and low annotation cost. To close the gap with supervised methods, recent works take advantage of extra constraints, e.g., semantic segmentation. However, these methods will inevitably increase the burden on the model. In this paper, we show theoretical and empirical evidence that the potential capacity of self-supervised monocular depth estimation can be excavated without increasing this cost. In particular, we propose (1) a novel data augmentation approach called data grafting, which forces the model to explore more cues to infer depth besides the vertical image position, (2) an exploratory self-distillation loss, which is supervised by the self-distillation label generated by our new post-processing method - selective post-processing, and (3) the full-scale network, designed to endow the encoder with the specialization of depth estimation task and enhance the representational power of the model. Extensive experiments show that our contributions can bring significant performance improvement to the baseline with even less computational overhead, and our model, named EPCDepth, surpasses the previous state-of-the-art methods even those supervised by additional constraints. Code is available at https://github.com/prstrive/EPCDepth.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers15
- Self-supervised Monocular Depth Estimation: Let's Talk About The WeatherKieran Saunders, George Vogiatzis, Luis J. MansoICCV 2023 · 64 citations
- SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth EstimationYouhong Wang, Yunji Liang, Hao Xu, Shaohui Jiao et al.AAAI 2024 · 60 citations
- Exploiting Pseudo Labels in a Self-Supervised Learning Framework for Improved Monocular Depth EstimationAndra Petrovai, Sergiu NedevschiCVPR 2022 · 56 citations
- GasMono: Geometry-Aided Self-Supervised Monocular Depth Estimation for Indoor ScenesChaoqiang Zhao, Matteo Poggi, Fabio Tosi, Lei Zhou et al.ICCV 2023 · 27 citations
- Jasmine: Harnessing Diffusion Prior for Self-supervised Depth EstimationJiyuan Wang, Chunyu Lin, Cheng Guan, Lang Nie et al.NeurIPS 2025 · 26 citations
Builds on14
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Random Erasing Data AugmentationZhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li et al.AAAI 2020 · 4,134 citations
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self DistillationLinfeng Zhang, Jiebo Song, Anni Gao, Jingwei Chen et al.ICCV 2019 · 1,069 citations
- Learning Lightweight Lane Detection CNNs by Self Attention DistillationYuenan Hou, Zheng Ma, Chunxiao Liu, Chen Change LoyICCV 2019 · 666 citations
Related papers
- Three Ways To Improve Semantic Segmentation With Self-Supervised Depth EstimationLukas Hoyer, Dengxin Dai, Yuhua Chen, Adrian Köring et al.CVPR 2021
- Semantically-Guided Representation Learning for Self-Supervised Monocular DepthVitor Guizilini, Rui Hou, Jie Li, Rares Ambrus et al.ICLR 2020 · 264 citations
- AggNet for Self-supervised Monocular Depth Estimation: Go An Aggressive Step FurtheZhi Chen, Xiaoqing Ye, Liang Du, Wei Yang et al.ACM MM 2021 · 6 citations
- PPEA-Depth: Progressive Parameter-Efficient Adaptation for Self-Supervised Monocular Depth EstimationYue-Jiang Dong, Yuan-Chen Guo, Ying-Tian Liu, Fang-Lue Zhang et al.AAAI 2024 · 9 citations
- Can Scale-Consistent Monocular Depth Be Learned in a Self-Supervised Scale-Invariant Manner?Lijun Wang, Yifan Wang, Linzhao Wang, Yunlong Zhan et al.ICCV 2021 · 48 citations
