Adaptive Surface Normal Constraint for Depth Estimation
Xiaoxiao Long, Cheng Lin, Lingjie Liu, Wei Li, Christian Theobalt, Ruigang Yang, Wenping Wang
Abstract
We present a novel method for single image depth estimation using surface normal constraints. Existing depth estimation methods either suffer from the lack of geometric constraints, or are limited to the difficulty of reliably capturing geometric context, which leads to a bottleneck of depth estimation quality. We therefore introduce a simple yet effective method, named Adaptive Surface Normal (ASN) constraint, to effectively correlate the depth estimation with geometric consistency. Our key idea is to adaptively determine the reliable local geometry from a set of randomly sampled candidates to derive surface normal constraint, for which we measure the consistency of the geometric contextual features. As a result, our method can faithfully reconstruct the 3D geometry and is robust to local shape variations, such as boundaries, sharp corners and noises. We conduct extensive evaluations and comparisons using public datasets. The experimental results demonstrate our method outperforms the state-of-the-art methods and has superior efficiency and robustness. Codes are available at: https://github.com/xxlong0/ASNDepth
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext fcb976a8-245d-4ba7-aa3b-59859416d110Cited by top-tier papers21
- Wonder3D: Single Image to 3D Using Cross-Domain DiffusionXiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu et al.CVPR 2024 · 269 citations
- P3Depth: Monocular Depth Estimation with a Piecewise Planarity PriorVaishakh Patil, Christos Sakaridis, Alexander Liniger, Luc Van GoolCVPR 2022 · 144 citations
- Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with TransformersZi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li et al.CVPR 2024 · 119 citations
- IEBins: Iterative Elastic Bins for Monocular Depth EstimationShuwei Shao, Zhongcai Pei, Xingming Wu, Zhong Liu et al.NeurIPS 2023 · 114 citations
- Self-supervised Monocular Depth Estimation for All Day Images using Domain SeparationLina Liu, Xibin Song, Mengmeng Wang, Yong Liu et al.ICCV 2021 · 95 citations
Builds on4
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Enforcing Geometric Constraints of Virtual Normal for Depth PredictionWei Yin, Yifan Liu, Chunhua Shen, Youliang YanICCV 2019 · 487 citations
- Depth Completion From Sparse LiDAR Data With Depth-Normal ConstraintsYan Xu, Xinge Zhu, Jianping Shi, Guofeng Zhang et al.ICCV 2019 · 249 citations
- Normal Assisted Stereo Depth EstimationUday Kusupati, Shuo Cheng, Rui Chen, Hao SuCVPR 2020
Related papers
- CORE: Co-planarity Regularized Monocular Geometry Estimation with Weak SupervisionYuguang Li, Kai Wang, Hui Li, Seon-Min Rhee et al.ICCV 2023
- Consistent video depth estimationXuan Luo, Jia-Bin Huang, Richard Szeliski, Kevin Matzen et al.SIGGRAPH 2020 · 321 citations
- Deep Depth From Aberration MapMasako Kashiwagi, Nao Mishima, Tatsuo Kozakaya, Shinsaku HiuraICCV 2019 · 9 citations
- NDDepth: Normal-Distance Assisted Monocular Depth EstimationShuwei Shao, Zhongcai Pei, Weihai Chen, Xingming Wu et al.ICCV 2023 · 76 citations
- Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal EstimationGwangbin Bae, Ignas Budvytis, Roberto CipollaICCV 2021 · 154 citations
