Dual Graph Regularized Deep Unfolding Network for Guided Depth Map Super-resolution
Zhiwei Zhong, Peilin Chen, Qiangqiang Shen, Bo Li, Shiqi Wang
摘要
Depth map super-resolution with color guidance is a fundamental task in computer vision that aims to reconstruct high-resolution depth maps by leveraging structural correlations from corresponding guidance images. Recently, with the development of deep learning techniques, the performance of guided depth super-resolution (GDSR) models has been significantly improved. However, most existing approaches rely on black-box architectures that lack theoretical interpretability. Although graph optimization has been explored to integrate model-driven and data-driven frameworks, it remains computationally expensive and struggles to preserve the intrinsic structures of the depth maps. To overcome these limitations, we propose a novel GDSR framework based on a dual graph Laplacian prior, termed LapNet, which efficiently unfolds graph optimization into a deep neural network. Specifically, we first formulate a dual graph Laplacian prior that separately models structural dependencies along the row and column dimensions of the depth maps. This formulation explicitly enforces piecewise smoothness while reducing computational complexity from O(H 3 W 3 ) to O(H 3 + W 3 ) by avoiding the construction of global affinity graph. Furthermore, we develop a deep implicit prior to extract high-frequency structural cues from the guidance image, serving as a complementary component to the manually designed prior. Finally, we integrate these complementary priors into a unified variational optimization framework, which is efficiently solved through alternating minimization and subsequently unfolded into an interpretable multi-stage deep network. Extensive experiments on both synthetic and real-world datasets demonstrate that LapNet achieves state-of-the-art performance while maintaining low computational complexity.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了最后一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
它引用的顶会 Paper16
- Discrete Cosine Transform Network for Guided Depth Map Super-ResolutionZixiang Zhao, Jiangshe Zhang, Shuang Xu, Zudi Lin 等CVPR 2022 · 被引用 120 次
- VolumeFusion: Deep Depth Fusion for 3D Scene ReconstructionJaesung Choe, Sunghoon Im, François Rameau, Minjun Kang 等ICCV 2021 · 被引用 83 次
- Depth Perception in Augmented Reality: The Effects of Display, Shadow, and PositionHaley Adams, Jeanine K. Stefanucci, Sarah H. Creem-Regehr, Bobby BodenheimerIEEE VR 2022 · 被引用 78 次
- Joint Implicit Image Function for Guided Depth Super-ResolutionJiaxiang Tang, Xiaokang Chen, Gang ZengACM MM 2021 · 被引用 78 次
- SGNet: Structure Guided Network via Gradient-Frequency Awareness for Depth Map Super-resolutionZhengxue Wang, Zhiqiang Yan, Jian YangAAAI 2024 · 被引用 64 次
相关 Paper
- Indoor Depth Recovery Based on Deep Unfolding with Non-Local PriorYuhui Dai, Junkang Zhang, Faming Fang, Guixu ZhangICCV 2023 · 被引用 2 次
- Learning Graph Regularisation for Guided Super-ResolutionRiccardo de Lutio, Alexander Becker, Stefano D'Aronco, Stefania Russo 等CVPR 2022 · 被引用 40 次
- BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth EstimationQi Tang, Runmin Cong, Ronghui Sheng, Lingzhi He 等ACM MM 2021 · 被引用 47 次
- Symmetric Uncertainty-Aware Feature Transmission for Depth Super-ResolutionWuxuan Shi, Mang Ye, Bo DuACM MM 2022 · 被引用 23 次
- Deep Unfolded Network with Intrinsic Supervision for Pan-SharpeningHebaixu Wang, Meiqi Gong, Xiaoguang Mei, Hao Zhang 等AAAI 2024 · 被引用 29 次
