A Practical Stereo Depth System for Smart Glasses
Jialiang Wang, Daniel Scharstein, Akash Bapat, Kevin Blackburn-Matzen, Matthew Yu, Jonathan Lehman, Suhib Alsisan, Yanghan Wang, Sam S. Tsai, Jan-Michael Frahm, Zijian He, Peter Vajda
Abstract
Figure 1. (a) Overview. The user captures a stereo pair with smart glasses. The images are sent to the user's phone for processing, including online rectification and fast disparity prediction via neural networks. The predicted disparity map is then used to generate visual effects by rendering novel views. (b) Zero-shot accuracy. Our stereo network, Argos, achieves high accuracy despite not being trained on these datasets, being quantized to 8 bits, and being significantly faster than SotA models such as RAFT-stereo [18], GA-Net [45] and LEA-Stereo [3].
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers4
- Learning Robust Stereo Matching in the Wild with Selective Mixture-of-ExpertsYun Wang, Longguang Wang, Chenghao Zhang, Yongjian Zhang et al.ICCV 2025 · 6 citations
- VueBuds: Visual Intelligence with Wireless EarbudsMaruchi Kim, Rasya Fawwaz, Zhi Yang Lim, Brinda Moudgalya et al.CHI 2026 · 1 citation
- Rectification-specific Supervision and Constrained Estimator for Online Stereo RectificationRui Gong, Kim-Hui Yap, Weide Liu, Xulei Yang et al.CVPR 2025
- Efficient Depth Estimation for Unstable Stereo Camera Systems on AR GlassesYongfan Liu, Hyoukjun KwonCVPR 2025
Builds on7
- Vision Transformers for Dense PredictionRené Ranftl, Alexey Bochkovskiy, Vladlen KoltunICCV 2021 · 2,647 citations
- Digging Into Self-Supervised Monocular Depth EstimationClément Godard, Oisin Mac Aodha, Michael Firman, Gabriel J. BrostowICCV 2019 · 2,416 citations
- Hierarchical Neural Architecture Search for Deep Stereo MatchingXuelian Cheng, Yiran Zhong, Mehrtash Harandi, Yuchao Dai et al.NeurIPS 2020 · 436 citations
- Practical Stereo Matching via Cascaded Recurrent Network with Adaptive CorrelationJiankun Li, Peisen Wang, Pengfei Xiong, Tao Cai et al.CVPR 2022 · 294 citations
- Toward Practical Monocular Indoor Depth EstimationCho-Ying Wu, Jialiang Wang, Michael Hall, Ulrich Neumann et al.CVPR 2022 · 68 citations
Related papers
- NeRF-Supervised Deep StereoFabio Tosi, Alessio Tonioni, Daniele De Gregorio, Matteo PoggiCVPR 2023
- High-Quality Stereo Image Restoration From Double RefractionHakyeong Kim, Andreas Meuleman, Daniel S. Jeon, Min H. KimCVPR 2021
- SMD-Nets: Stereo Mixture Density NetworksFabio Tosi, Yiyi Liao, Carolin Schmitt, Andreas GeigerCVPR 2021
- Learning to Render Novel Views from Wide-Baseline Stereo PairsYilun Du, Cameron Smith, Ayush Tewari, Vincent SitzmannCVPR 2023
- GS-ASM: 2DGS-Supervised Active Stereo MatchingZhengling Wu, Rongfeng Lu, Quan Chen, Longjian Zeng et al.CVPR 2026
