Dual Graph Regularized Deep Unfolding Network for Guided Depth Map Super-resolution
Zhiwei Zhong, Peilin Chen, Qiangqiang Shen, Bo Li, Shiqi Wang
Abstract
Depth map super-resolution with color guidance is a fundamental task in computer vision that aims to reconstruct high-resolution depth maps by leveraging structural correlations from corresponding guidance images. Recently, with the development of deep learning techniques, the performance of guided depth super-resolution (GDSR) models has been significantly improved. However, most existing approaches rely on black-box architectures that lack theoretical interpretability. Although graph optimization has been explored to integrate model-driven and data-driven frameworks, it remains computationally expensive and struggles to preserve the intrinsic structures of the depth maps. To overcome these limitations, we propose a novel GDSR framework based on a dual graph Laplacian prior, termed LapNet, which efficiently unfolds graph optimization into a deep neural network. Specifically, we first formulate a dual graph Laplacian prior that separately models structural dependencies along the row and column dimensions of the depth maps. This formulation explicitly enforces piecewise smoothness while reducing computational complexity from O(H 3 W 3 ) to O(H 3 + W 3 ) by avoiding the construction of global affinity graph. Furthermore, we develop a deep implicit prior to extract high-frequency structural cues from the guidance image, serving as a complementary component to the manually designed prior. Finally, we integrate these complementary priors into a unified variational optimization framework, which is efficiently solved through alternating minimization and subsequently unfolded into an interpretable multi-stage deep network. Extensive experiments on both synthetic and real-world datasets demonstrate that LapNet achieves state-of-the-art performance while maintaining low computational complexity.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fe58466d-8a18-45ed-970e-bc9b737e2d0aBuilds on16
- Discrete Cosine Transform Network for Guided Depth Map Super-ResolutionZixiang Zhao, Jiangshe Zhang, Shuang Xu, Zudi Lin et al.CVPR 2022 · 120 citations
- VolumeFusion: Deep Depth Fusion for 3D Scene ReconstructionJaesung Choe, Sunghoon Im, François Rameau, Minjun Kang et al.ICCV 2021 · 83 citations
- Depth Perception in Augmented Reality: The Effects of Display, Shadow, and PositionHaley Adams, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, Bobby BodenheimerIEEE VR 2022 · 78 citations
- Joint Implicit Image Function for Guided Depth Super-ResolutionJiaxiang Tang, Xiaokang Chen, Gang ZengACM MM 2021 · 78 citations
- SGNet: Structure Guided Network via Gradient-Frequency Awareness for Depth Map Super-resolutionZhengxue Wang, Zhiqiang Yan, Jian YangAAAI 2024 · 64 citations
Related papers
- Indoor Depth Recovery Based on Deep Unfolding with Non-Local PriorYuhui Dai, Junkang Zhang, Faming Fang, Guixu ZhangICCV 2023 · 2 citations
- Learning Graph Regularisation for Guided Super-ResolutionRiccardo de Lutio, Alexander Becker, Stefano D'Aronco, Stefania Russo et al.CVPR 2022 · 40 citations
- BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth EstimationQi Tang, Runmin Cong, Ronghui Sheng, Lingzhi He et al.ACM MM 2021 · 47 citations
- Symmetric Uncertainty-Aware Feature Transmission for Depth Super-ResolutionWuxuan Shi, Mang Ye, Bo DuACM MM 2022 · 23 citations
- Deep Unfolded Network with Intrinsic Supervision for Pan-SharpeningHebaixu Wang, Meiqi Gong, Xiaoguang Mei, Hao Zhang et al.AAAI 2024 · 29 citations
