Learnable Burst-Encodable Time-of-Flight Imaging for High-Fidelity Long-Distance Depth Sensing
Manchao Bao, Shengjiang Fang, Tao Yue, Xuemei Hu
Abstract
Long-distance depth imaging holds great promise for applications such as autonomous driving and robotics. Direct time-of-flight (dToF) imaging offers highprecision, long-distance depth sensing, yet demands ultra-short pulse light sources and high-resolution time-to-digital converters. In contrast, indirect time-of-flight (iToF) imaging often suffers from phase wrapping and low signal-to-noise ratio (SNR) as the sensing distance increases. In this paper, we introduce a novel ToF imaging paradigm, termed Burst-Encodable Time-of-Flight (BE-ToF), which facilitates high-fidelity, long-distance depth imaging. Specifically, the BE-ToF system emits light pulses in burst mode and estimates the phase delay of the reflected signal over the entire burst period, thereby effectively avoiding the phase wrapping inherent to conventional iToF systems. Moreover, to address the low SNR caused by light attenuation over increasing distances, we propose an end-to-end learnable framework that jointly optimizes the coding functions and the depth reconstruction network. A specialized double well function and first-order difference term are incorporated into the framework to ensure the hardware implementability of the coding functions. The proposed approach is rigorously validated through comprehensive simulations and real-world prototype experiments, demonstrating its effectiveness and practical applicability. The code is available at: https://github.com/ComputationalPerceptionLab/BE-ToF.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Builds on8
- Restormer: Efficient Transformer for High-Resolution Image RestorationSyed Waqas Zamir, Aditya Arora, Salman Khan, Munawar Hayat et al.CVPR 2022 · 3,348 citations
- Fisher Information Guidance for Learned Time-of-Flight ImagingJiaqu Li, Tao Yue, Sijie Zhao, Xuemei HuCVPR 2022 · 7 citations
- iToF-Flow-Based High Frame Rate Depth ImagingYu Meng, Zhou Xue, Xu Chang, Xuemei Hu et al.CVPR 2024 · 3 citations
- Towards Fast and Accurate Real-World Depth Super-Resolution: Benchmark Dataset and BaselineLingzhi He, Hongguang Zhu, Feng Li, Huihui Bai et al.CVPR 2021
- ECA-Net: Efficient Channel Attention for Deep Convolutional Neural NetworksQilong Wang, Banggu Wu, Pengfei Zhu, Peihua Li et al.CVPR 2020
Related papers
- Revisiting Optimal Coding for I-ToF under Practical Sensor ConstraintsWENBIN LUO, Takafumi Iwaguchi, Ryusuke Sagawa, Hiroshi KawasakiCVPR 2026
- All-photon Polarimetric Time-of-Flight ImagingSeung-Hwan Baek, Felix HeideCVPR 2022 · 9 citations
- Mask-ToF: Learning Microlens Masks for Flying Pixel Correction in Time-of-Flight ImagingIlya Chugunov, Seung-Hwan Baek, Qiang Fu, Wolfgang Heidrich et al.CVPR 2021
- CodedStereo: Learned Phase Masks for Large Depth-of-Field StereoShiyu Tan, Yicheng Wu, Shoou-I Yu, Ashok VeeraraghavanCVPR 2021
- CEDAR: Computing-in-pixel Edge-aware Detection and Reconstruction Architecture for High-resolution 3D ImagingBu Chen, Zhangcheng Huang, Qi Zheng, Weiyi Tang et al.DAC 2024 · 1 citation
