R-MSFM: Recurrent Multi-Scale Feature Modulation for Monocular Depth Estimating
Zhongkai Zhou, Xinnan Fan, Pengfei Shi, Yuanxue Xin
Abstract
In this paper, we propose Recurrent Multi-Scale Feature Modulation (R-MSFM), a new deep network architecture for self-supervised monocular depth estimation. R-MSFM extracts per-pixel features, builds a multi-scale feature modulation module, and iteratively updates an inverse depth through a parameter-shared decoder at the fixed resolution. This architecture enables our R-MSFM to maintain semantically richer while spatially more precise representations and avoid the error propagation caused by the traditional U-Net-like coarse-to-fine architecture widely used in this domain, resulting in strong generalization and efficient parameter count. Experimental results demonstrate the superiority of our proposed R-MSFM both at model size and inference speed, and show the state-of-the-art results on the KITTI benchmark. Code is available at https://github.com/jsczzzk/R-MSFM
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers12
- Deep Digging into the Generalization of Self-Supervised Monocular Depth EstimationJinwoo Bae, Sungho Moon, Sunghoon ImAAAI 2023 · 127 citations
- Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth LearningXiaofeng Wang, Zheng Zhu, Guan Huang, Xu Chi et al.AAAI 2023 · 31 citations
- Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution NetworkWencheng Han, Junbo Yin, Jianbing ShenICCV 2023 · 30 citations
- Jasmine: Harnessing Diffusion Prior for Self-supervised Depth EstimationJiyuan Wang, Chunyu Lin, Cheng Guan, Lang Nie et al.NeurIPS 2025 · 26 citations
- Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth EstimationZhengming Zhou, Qiulei DongICCV 2023 · 16 citations
Builds on7
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual OdometryNan Yang, Lukas von Stumberg, Rui Wang, Daniel CremersCVPR 2020
- Self-Supervised Monocular Trained Depth Estimation Using Self-Attention and Discrete Disparity VolumeAdrian Johnston, Gustavo CarneiroCVPR 2020
- Learning Depth-Guided Convolutions for Monocular 3D Object DetectionMingyu Ding, Yuqi Huo, Hongwei Yi, Zhe Wang et al.CVPR 2020
- Disp R-CNN: Stereo 3D Object Detection via Shape Prior Guided Instance Disparity EstimationJiaming Sun, Linghao Chen, Yiming Xie, Siyu Zhang et al.CVPR 2020
Related papers
- RM-Depth: Unsupervised Learning of Recurrent Monocular Depth in Dynamic ScenesTak-Wai HuiCVPR 2022 · 62 citations
- Multi-Frame Self-Supervised Depth with TransformersVitor Guizilini, Rares Ambrus, Dian Chen, Sergey Zakharov et al.CVPR 2022 · 95 citations
- Learning Occlusion-aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth EstimationZhengming Zhou, Qiulei DongACM MM 2022 · 21 citations
- Seeing Depth Through Frequency and Motion: A Progressive Training Paradigm for Monocular Depth EstimationKe Li, Bolin Song, Hongbo LiuCVPR 2026
- SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth EstimationYouhong Wang, Yunji Liang, Hao Xu, Shaohui Jiao et al.AAAI 2024 · 60 citations
