Consistent Time-of-Flight Depth Denoising via Graph-Informed Geometric Attention
Weida Wang, Changyong He, Jin Zeng, Di Qiu
Abstract
Depth images captured by Time-of-Flight (ToF) sensors are prone to noise, requiring denoising for reliable downstream applications. Previous works either focus on single-frame processing, or perform multi-frame processing without considering depth variations at corresponding pixels across frames, leading to undesirable temporal inconsistency and spatial ambiguity. In this paper, we propose a novel ToF depth denoising network leveraging motion-invariant graph fusion to simultaneously enhance temporal stability and spatial sharpness. Specifically, despite depth shifts across frames, graph structures exhibit temporal self-similarity, enabling cross-frame geometric attention for graph fusion. Then, by incorporating an image smoothness prior on the fused graph and data fidelity term derived from ToF noise distribution, we formulate a maximum a posterior problem for ToF denoising. Finally, the solution is unrolled into iterative filters whose weights are adaptively learned from the graph-informed geometric attention, producing a highperformance yet interpretable network. Experimental results demonstrate that the proposed scheme achieves stateof-the-art performance in terms of accuracy and consistency on synthetic DVToF dataset and exhibits robust generalization on the real Kinectv2 dataset. Source code will be released at https://github.com/davidweidawang/GIGA-ToF.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on5
- DepthLab: Real-time 3D Interaction with Depth Maps for Mobile Augmented RealityRuofei Du, Eric Turner, Maksym Dzitsiuk, Luca Prasso et al.UIST 2020 · 145 citations
- RADU: Ray-Aligned Depth Update Convolutions for ToF Data DenoisingMichael Schelling, Pedro Hermosilla, Timo RopinskiCVPR 2022 · 18 citations
- Interpretable Lightweight Transformer via Unrolling of Learned Graph Smoothness PriorsViet Ho Tam Thuc Do, Parham Eftekhar, Seyed Alireza Hosseini, Gene Cheung et al.NeurIPS 2024 · 13 citations
- Joint Graph-Based Depth Refinement and Normal EstimationMattia Rossi, Mireille El Gheche, Andreas Kuhn, Pascal FrossardCVPR 2020
- Consistent Direct Time-of-Flight Video Depth Super-ResolutionZhanghao Sun, Wei Ye, Jinhui Xiong, Gyeongmin Choe et al.CVPR 2023
Related papers
- SVDC: Consistent Direct Time-of-Flight Video Depth Completion with Frequency Selective FusionXuan Zhu, Jijun Xiang, Xianqi Wang, Longliang Liu et al.CVPR 2025
- Leveraging Consistent Spatio-Temporal Correspondence for Robust Visual OdometryZhaoxing Zhang, Junda Cheng, Gangwei Xu, Xiaoxiang Wang et al.AAAI 2025 · 9 citations
- Progressive Point Cloud Denoising with Cross-Stage Cross-Coder Adaptive Edge Graph Convolution NetworkWu Chen, Hehe Fan, Qiuping Jiang, Chao Huang et al.ACM MM 2024 · 6 citations
- Deep End-to-End Alignment and Refinement for Time-of-Flight RGB-D ModuleDi Qiu, Jiahao Pang, Wenxiu Sun, Chengxi YangICCV 2019 · 33 citations
- TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View SynthesisBenjamin Attal, Eliot Laidlaw, Aaron Gokaslan, Changil Kim et al.NeurIPS 2021 · 140 citations
