RangeDet: In Defense of Range View for LiDAR-based 3D Object Detection
Lue Fan, Xuan Xiong, Feng Wang, Naiyan Wang, Zhaoxiang Zhang
Abstract
In this paper, we propose an anchor-free single-stage LiDAR-based 3D object detector – RangeDet. The most notable difference with previous works is that our method is purely based on the range view representation. Compared with the commonly used voxelized or Bird’s Eye View (BEV) representations, the range view representation is more compact and without quantization error. Although there are works adopting it for semantic segmentation, its performance in object detection is largely behind voxelized or BEV counterparts. We first analyze the existing range-view-based methods and find two issues overlooked by previous works: 1) the scale variation between nearby and far away objects; 2) the inconsistency between the 2D range image coordinates used in feature extraction and the 3D Cartesian coordinates used in output. Then we deliberately design three components to address these issues in our RangeDet. We test our RangeDet in the large-scale Waymo Open Dataset (WOD). Our best model achieves 72.9/75.9/65.8 3D AP on vehicle/pedestrian/cyclist. These results outperform other range-view-based methods by a large margin, and are overall comparable with the state-of-the-art multi-view-based methods. Codes will be released at https://github.com/TuSimple/RangeDet.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext d1a56310-1af7-473b-a2ce-b1ebff7244faCited by top-tier papers53
- TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with TransformersXuyang Bai, Zeyu Hu, Xinge Zhu, Qingqiu Huang et al.CVPR 2022 · 794 citations
- BEVFusion: A Simple and Robust LiDAR-Camera Fusion FrameworkTingting Liang, Hongwei Xie, Kaicheng Yu, Zhongyu Xia et al.NeurIPS 2022 · 762 citations
- Unifying Voxel-based Representation with Transformer for 3D Object DetectionYanwei Li, Yilun Chen, Xiaojuan Qi, Zeming Li et al.NeurIPS 2022 · 401 citations
- SurroundOcc: Multi-Camera 3D Occupancy Prediction for Autonomous DrivingYi Wei, Linqing Zhao, Wenzhao Zheng, Zheng Zhu et al.ICCV 2023 · 380 citations
- DeepInteraction: 3D Object Detection via Modality InteractionZeyu Yang, Jiaqi Chen, Zhenwei Miao, Wei Li et al.NeurIPS 2022 · 268 citations
Builds on10
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- Voxel R-CNN: Towards High Performance Voxel-based 3D Object DetectionJiajun Deng, Shaoshuai Shi, Peiwei Li, Wengang Zhou et al.AAAI 2021 · 1,128 citations
- Scale-Aware Trident Networks for Object DetectionYanghao Li, Yuntao Chen, Naiyan Wang, Zhaoxiang ZhangICCV 2019 · 1,031 citations
- STD: Sparse-to-Dense 3D Object Detector for Point CloudZetong Yang, Yanan Sun, Shu Liu, Xiaoyong Shen et al.ICCV 2019 · 840 citations
- VarifocalNet: An IoU-Aware Dense Object DetectorHaoyang Zhang, Ying Wang, Feras Dayoub, Niko SünderhaufCVPR 2021
Related papers
- RangePerception: Taming LiDAR Range View for Efficient and Accurate 3D Object DetectionYeqi Bai, Ben Fei, Youquan Liu, Tao Ma et al.NeurIPS 2023 · 11 citations
- Fully Convolutional One-Stage 3D Object Detection on LiDAR Range ImagesZhi Tian, Xiangxiang Chu, Xiaoming Wang, Xiaolin Wei et al.NeurIPS 2022 · 168 citations
- RSN: Range Sparse Net for Efficient, Accurate LiDAR 3D Object DetectionPei Sun, Weiyue Wang, Yuning Chai, Gamaleldin Elsayed et al.CVPR 2021
- LiDAR R-CNN: An Efficient and Universal 3D Object DetectorZhichao Li, Feng Wang, Naiyan WangCVPR 2021
- RangeIoUDet: Range Image Based Real-Time 3D Object Detector Optimized by Intersection Over UnionZhidong Liang, Zehan Zhang, Ming Zhang, Xian Zhao et al.CVPR 2021
