Dual-branch Graph Feature Learning for NLOS Imaging
Xiongfei Su, Tianyi Zhu, Lina Liu, Zheng Chen, Yulun Zhang, Siyuan Li, Juntian Ye, Feihu Xu, Xin Yuan
Abstract
The domain of non-line-of-sight (NLOS) imaging is advancing rapidly, offering the capability to reveal occluded scenes that are not directly visible. However, contemporary NLOS systems face several significant challenges: (1) The computational and storage requirements are profound due to the inherent three-dimensional grid data structure, which restricts practical application. ( 2 ) The simultaneous reconstruction of albedo and depth information requires a delicate balance using hyperparameters in the loss function, rendering the concurrent reconstruction of texture and depth information difficult. This paper introduces the innovative methodology, DG-NLOS, which integrates an albedo-focused reconstruction branch dedicated to albedo information recovery and a depth-focused reconstruction branch that extracts geometrical structure, to overcome these obstacles. The dualbranch framework segregates content delivery to the respective reconstructions, thereby enhancing the quality of the retrieved data. To our knowledge, we are the first to employ the GNN as a fundamental component to transform dense NLOS grid data into sparse structural features for efficient reconstruction. Comprehensive experiments demonstrate that our method attains the highest level of performance among existing methods across synthetic and real data. https://github.com/Nicholassu/DG-NLOS .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on19
- MLP-Mixer: An all-MLP Architecture for VisionIlya O. Tolstikhin, Neil Houlsby, Alexander Kolesnikov, Lucas Beyer et al.NeurIPS 2021 · 3,862 citations
- Graph Neural Networks Exponentially Lose Expressive Power for Node ClassificationKenta Oono, Taiji SuzukiICLR 2020 · 864 citations
- Fast Vision Transformers with HiLo AttentionZizheng Pan, Jianfei Cai, Bohan ZhuangNeurIPS 2022 · 321 citations
- Deep Generalized Unfolding Networks for Image RestorationChong Mou, Qian Wang, Jian ZhangCVPR 2022 · 257 citations
- Object DGCNN: 3D Object Detection using Dynamic GraphsYue Wang, Justin M. SolomonNeurIPS 2021 · 127 citations
Related papers
- Enhancing Non-line-of-sight Imaging via Learnable Inverse Kernel and Attention MechanismsYanhua Yu, Siyuan Shen, Zi Wang, Binbin Huang et al.ICCV 2023 · 19 citations
- Non-Line-of-Sight Surface Reconstruction Using the Directional Light-Cone TransformSean I. Young, David B. Lindell, Bernd Girod, David Taubman et al.CVPR 2020
- NLOST: Non-Line-of-Sight Imaging with TransformerYue Li, Jiayong Peng, Juntian Ye, Yueyi Zhang et al.CVPR 2023
- Seeing through boxes: Non-Line-of-Sight 3D Reconstruction from Radar SignalsJiachen Lu, Hailan Shanbhag, Haitham Al HassaniehCVPR 2026 · 1 citation
- Non-Line-of-Sight Imaging with Signal Superresolution NetworkJianyu Wang, Xintong Liu, Leping Xiao, Zuoqiang Shi et al.CVPR 2023
