HFD-Teacher: High-Frequency Depth Distillation From Depth Foundation Models for Enhanced Depth Completion
Zhiyuan Yang, Anqi Cheng, Haiyue Zhu, Tianjiao Li, Pey Yuen Tao, Kezhi Mao
摘要
Depth completion, the task of reconstructing dense depth maps from sparse depth and RGB images, plays a critical role in 3D scene understanding. However, existing methods often struggle to recover high-frequency details, such as regions with fine structures or weak signals, since depth sensors may fail to capture accurate depth maps in those regions, leading to imperfect supervision ground truth. To overcome this limitation, it is essential to introduce an alternative training source for the models. Emerging depth foundation models excel at producing high-frequency details from RGB images, yet their depth maps suffer from inconsistent scaling. Therefore, we propose a novel teacherstudent framework that enhances depth completion by distilling high-frequency knowledge from depth foundation This ICCV paper is the Open Access version, provided by the Computer Vision Foundation.
Except for this watermark, it is identical to the accepted version; the final published version of the proceedings is available on IEEE Xplore. models across multiple scales. Our approach introduces two key innovations: Adaptive Local Wavelet Decomposition, which dynamically adjusts wavelet decomposition level based on local complexity for efficient feature extraction, and Topological Constraints, which apply persistent homology to enforce structural coherence and suppress spurious depth edges. Experiment results demonstrate that our method outperforms state-of-the-art methods, preserving high-frequency details and overall depth fidelity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- High-Resolution Image Synthesis with Latent Diffusion ModelsRobin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser 等CVPR 2022 · 被引用 13,123 次
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 被引用 2,647 次
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao 等NeurIPS 2024 · 被引用 2,305 次
- CSPN++: Learning Context and Resource Aware Convolutional Spatial Propagation Networks for Depth CompletionXinjing Cheng, Peng Wang, Chenye Guan, Ruigang YangAAAI 2020 · 被引用 270 次
- Dynamic Spatial Propagation Network for Depth CompletionYuankai Lin, Tao Cheng, Qi Zhong, Wending Zhou 等AAAI 2022 · 被引用 155 次
相关 Paper
- Distilling Monocular Foundation Model for Fine-grained Depth CompletionYingping Liang, Yutao Hu, Wenqi Shao, Ying FuCVPR 2025
- Aggregating Feature Point Cloud for Depth CompletionZhu Yu, Zehua Sheng, Zili Zhou, Lun Luo 等ICCV 2023 · 被引用 42 次
- FCFR-Net: Feature Fusion based Coarse-to-Fine Residual Learning for Depth CompletionLina Liu, Xibin Song, Xiaoyang Lyu, Junwei Diao 等AAAI 2021 · 被引用 125 次
- Zero-shot Depth Completion via Test-time Alignment with Affine-invariant Depth PriorLee Hyoseok, Kyeong Seon Kim, Byung-Ki Kwon, Tae-Hyun OhAAAI 2025 · 被引用 11 次
- Single Image Depth Prediction With Wavelet DecompositionMichaël Ramamonjisoa, Michael Firman, Jamie Watson, Vincent Lepetit 等CVPR 2021
