GS-ASM: 2DGS-Supervised Active Stereo Matching
Zhengling Wu, Rongfeng Lu, Quan Chen, Longjian Zeng, Ming Lu, Yaoqi Sun, Yahong Chen, Baofeng Ji, Chenggang Yan
Abstract
Due to the lack of ground truth, existing methods of active stereo matching generally employ fully self-supervised learning to produce precise depth estimates. Although they can achieve promising results, their performance still has a noticeable gap compared with supervised models. To fill this gap, we propose a novel framework that synthesizes proxy labels to enable supervised training of deep active stereo networks without requiring any ground-truth depth. To expand the training data and generate disparity proxy labels, we develop an active 2D Gaussian Splatting (2DGS)based synthesis method that explicitly models the scene geometry and the projected active pattern. Furthermore, to balance the varying contributions of different supervisions during training, we design a hybrid supervision regularization strategy that dynamically adjusts the loss weights to achieve stable optimization. We also contribute a realworld dataset captured by a handheld RealSense camera, along with our active 2DGS model, which facilitates future research on active stereo matching. Extensive experiments with multiple backbone networks demonstrate that our method achieves state-of-the-art performance on active stereo matching task. The code and dataset will be publicly released.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- 3D Gaussian Splatting for Real-Time Radiance Field RenderingBernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George DrettakisSIGGRAPH 2023 · 5,687 citations
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Depth Anything V2Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao et al.NeurIPS 2024 · 2,305 citations
- Depth Anything: Unleashing the Power of Large-Scale Unlabeled DataLihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu et al.CVPR 2024 · 847 citations
- 2D Gaussian Splatting for Geometrically Accurate Radiance FieldsBinbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger et al.SIGGRAPH 2024 · 660 citations
Related papers
- NeRF-Supervised Deep StereoFabio Tosi, Alessio Tonioni, Daniele De Gregorio, Matteo PoggiCVPR 2023
- ActiveZero: Mixed Domain Learning for Active Stereovision with Zero AnnotationIsabella Liu, Edward Yang, Jianyu Tao, Rui Chen et al.CVPR 2022
- Active Stereo Without Pattern ProjectorLuca Bartolomei, Matteo Poggi, Fabio Tosi, Andrea Conti et al.ICCV 2023 · 12 citations
- Self-supervised Multi-view Stereo via Inter and Intra Network Pseudo DepthKe Qiu, Yawen Lai, Shiyi Liu, Ronggang WangACM MM 2022 · 9 citations
- Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View SynthesisLiang Han, Junsheng Zhou, Yu-Shen Liu, Zhizhong HanNeurIPS 2024 · 63 citations
