TerraSeg: Self-Supervised Ground Segmentation for Any LiDAR
Ted Lentsch, Santiago Montiel-Marín, Holger Caesar, Dariu M. Gavrila
Abstract
LiDAR perception is fundamental to robotics, enabling machines to understand their environment in 3D. A crucial task for LiDAR-based scene understanding and navigation is ground segmentation. Existing methods are either handcrafted for specific LiDAR configurations or require costly per-point manual labels, limiting generalization and scalability. We introduce TerraSeg, establishing the first self-supervised LiDAR foundation model for ground segmentation. We train TerraSeg on OmniLiDAR, a unified large-scale dataset that aggregates and standardizes LiDAR data from nine major public benchmarks, spanning over 20 million raw scans and 11 distinct sensor models, providing unprecedented diversity for learning a generalizable ground model. OmniLiDAR is pseudo-labeled by our PseudoLabeler, a novel self-supervised module that generates high-quality ground/non-ground labels through per-scan runtime optimization. Without any manual labels, TerraSeg achieves state-of-the-art results on nuScenes, SemanticKITTI, and Waymo Perception, and delivers close-to-real-time performance. Our code and models will be publicly released upon paper acceptance.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 378ec2c9-b5c4-408a-b93d-5e4f3881ab95Builds on14
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- Point Transformer V2: Grouped Vector Attention and Partition-based PoolingXiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu et al.NeurIPS 2022 · 924 citations
- Zenseact Open Dataset: A large-scale and diverse multimodal dataset for autonomous drivingMina Alibeigi, William Ljungbergh, Adam Tonderski, Georg Hess et al.ICCV 2023 · 106 citations
- UNION: Unsupervised 3D Object Detection using Object Appearance-based Pseudo-ClassesTed de Vries Lentsch, Holger Caesar, Dariu GavrilaNeurIPS 2024 · 30 citations
Related papers
- Temporal Overlapping Prediction: A Self-Supervised Pre-Training Method for LiDAR Moving Object SegmentationZiliang Miao, Runjian Chen, Yixi Cai, Buwei He et al.ICCV 2025 · 1 citation
- Implicit Surface Contrastive Clustering for LiDAR Point CloudsZaiwei Zhang, Min Bai, Li Erran LiCVPR 2023
- UniSeg: A Unified Multi-Modal LiDAR Segmentation Network and the OpenPCSeg CodebaseYouquan Liu, Runnan Chen, Xin Li, Lingdong Kong et al.ICCV 2023 · 94 citations
- Efficient LiDAR Point Cloud Oversegmentation NetworkLe Hui, Linghua Tang, Yuchao Dai, Jin Xie et al.ICCV 2023 · 7 citations
- Temporal Consistent 3D LiDAR Representation Learning for Semantic Perception in Autonomous DrivingLucas Nunes, Louis Wiesmann, Rodrigo Marcuzzi, Xieyuanli Chen et al.CVPR 2023
