Single Domain Generalization for LiDAR Semantic Segmentation
Hyeonseong Kim, Yoonsu Kang, Changgyoon Oh, Kuk-Jin Yoon
Abstract
With the success of the 3D deep learning models, various perception technologies for autonomous driving have been developed in the LiDAR domain. While these models perform well in the trained source domain, they struggle in unseen domains with a domain gap. In this paper, we propose a single domain generalization method for LiDAR semantic segmentation (DGLSS) that aims to ensure good performance not only in the source domain but also in the unseen domain by learning only on the source domain. We mainly focus on generalizing from a dense source domain and target the domain shift from different LiDAR sensor configurations and scene distributions. To this end, we augment the domain to simulate the unseen domains by randomly subsampling the LiDAR scans. With the augmented domain, we introduce two constraints for generalizable representation learning: sparsity invariant feature consistency (SIFC) and semantic correlation consistency (SCC). The SIFC aligns sparse internal features of the source domain with the augmented domain based on the feature affinity. For SCC, we constrain the correlation between class prototypes to be similar for every LiDAR scan. We also establish a standardized training and evaluation setting for DGLSS. With the proposed evaluation setting, our method showed improved performance in the unseen domains compared to other baselines. Even without access to the target domain, our method performed better than the domain adaptation method. The code is available at https://github.com/gzgzys9887/DGLSS.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 16ab1a1b-bf9d-48d1-8324-efb45b875904Cited by top-tier papers19
- Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic SegmentationZhixiang Wei, Lin Chen, Yi Jin, Xiaoxiao Ma et al.CVPR 2024 · 61 citations
- Single Domain Generalization for Crowd CountingZhuoxuan Peng, S.-H. Gary ChanCVPR 2024 · 27 citations
- UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse WeatherHaimei Zhao, Jing Zhang, Zhuo Chen, Shanshan Zhao et al.CVPR 2024 · 25 citations
- Three Pillars Improving Vision Foundation Model Distillation for LidarGilles Puy, Spyros Gidaris, Alexandre Boulch, Oriane Siméoni et al.CVPR 2024 · 19 citations
- TALoS: Enhancing Semantic Scene Completion via Test-time Adaptation on the Line of SightHyun-Kurl Jang, Jihun Kim, Hyeokjun Kweon, Kuk-Jin YoonNeurIPS 2024 · 17 citations
Builds on25
- KPConv: Flexible and Deformable Convolution for Point CloudsHugues Thomas, Charles R. Qi, Jean-Emmanuel Deschaud, Beatriz Marcotegui et al.ICCV 2019 · 3,193 citations
- SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR SequencesJens Behley, Martin Garbade, Andres Milioto, Jan Quenzel et al.ICCV 2019 · 2,345 citations
- Domain Generalization with MixStyleKaiyang Zhou, Yongxin Yang, Yu Qiao, Tao XiangICLR 2021 · 986 citations
- Deep Domain-Adversarial Image Generation for Domain GeneralisationKaiyang Zhou, Yongxin Yang, Timothy M. Hospedales, Tao XiangAAAI 2020 · 488 citations
- Episodic Training for Domain GeneralizationDa Li, Jianshu Zhang, Yongxin Yang, Cong Liu et al.ICCV 2019 · 488 citations
Related papers
- Walking Your LiDOG: A Journey Through Multiple Domains for LiDAR Semantic SegmentationCristiano Saltori, Aljosa Osep, Elisa Ricci, Laura Leal-TaixéICCV 2023 · 24 citations
- Domain generalization of 3D semantic segmentation in autonomous drivingJules Sanchez, Jean-Emmanuel Deschaud, François GouletteICCV 2023 · 37 citations
- Towards Universal LiDAR-Based 3D Object Detection by Multi-Domain Knowledge TransferGuile Wu, Tongtong Cao, Bingbing Liu, Xingxin Chen et al.ICCV 2023 · 7 citations
- SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point GenerationQiangeng Xu, Yin Zhou, Weiyue Wang, Charles R. Qi et al.ICCV 2021 · 172 citations
- Instant Domain Augmentation for LiDAR Semantic SegmentationKwonyoung Ryu, Soonmin Hwang, Jaesik ParkCVPR 2023
