WildNet: Learning Domain Generalized Semantic Segmentation from the Wild
Suhyeon Lee, Hongje Seong, Seongwon Lee, Euntai Kim
Abstract
We present a new domain generalized semantic segmentation network named WildNet, which learns domaingeneralized features by leveraging a variety of contents and styles from the wild. In domain generalization, the low generalization ability for unseen target domains is clearly due to overfitting to the source domain. To address this problem, previous works have focused on generalizing the domain by removing or diversifying the styles of the source domain. These alleviated overfitting to the source-style but overlooked overfitting to the source-content. In this paper, we propose to diversify both the content and style of the source domain with the help of the wild. Our main idea is for networks to naturally learn domain-generalized semantic information from the wild. To this end, we diversify styles by augmenting source features to resemble wild styles and enable networks to adapt to a variety of styles. Furthermore, we encourage networks to learn class-discriminant features by providing semantic variations borrowed from the wild to source contents in the feature space. Finally, we regularize networks to capture consistent semantic information even when both the content and style of the source domain are extended to the wild. Extensive experiments on five different datasets validate the effectiveness of our WildNet, and we significantly outperform state-of-the-art methods. The source code and model are available online: https://github.com/suhyeonlee/WildNet . * Corresponding author. (a) Unseen domain image (b) Baseline (mIoU 35.16%) (c) RobustNet (mIoU 36.58%) (d) Ours (mIoU 44.62%)
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers40
- Learning Content-Enhanced Mask Transformer for Domain Generalized Urban-Scene SegmentationQi Bi, Shaodi You, Theo GeversAAAI 2024 · 77 citations
- Learning Frequency-Adapted Vision Foundation Model for Domain Generalized Semantic SegmentationQi Bi, Jingjun Yi, Hao Zheng, Haolan Zhan et al.NeurIPS 2024 · 62 citations
- Stronger, Fewer, & Superior: Harnessing Vision Foundation Models for Domain Generalized Semantic SegmentationZhixiang Wei, Lin Chen, Yi Jin, Xiaoxiao Ma et al.CVPR 2024 · 61 citations
- Pasta: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain GeneralizationPrithvijit Chattopadhyay, Kartik Sarangmath, Vivek Vijaykumar, Judy HoffmanICCV 2023 · 57 citations
- Towards Open-Set Test-Time Adaptation Utilizing the Wisdom of Crowds in Entropy MinimizationJungsoo Lee, Debasmit Das, Jaegul Choo, Sungha ChoiICCV 2023 · 48 citations
Builds on25
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Deformable DETR: Deformable Transformers for End-to-End Object DetectionXizhou Zhu, Weijie Su, Lewei Lu, Bin Li et al.ICLR 2021 · 7,353 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Domain Generalization with MixStyleKaiyang Zhou, Yongxin Yang, Yu Qiao, Tao XiangICLR 2021 · 986 citations
- With a Little Help from My Friends: Nearest-Neighbor Contrastive Learning of Visual RepresentationsDebidatta Dwibedi, Yusuf Aytar, Jonathan Tompson, Pierre Sermanet et al.ICCV 2021 · 542 citations
Related papers
- Style Blind Domain Generalized Semantic Segmentation via Covariance Alignment and Semantic Consistence Contrastive LearningWoo-Jin Ahn, Geun-Yeong Yang, Hyun Duck Choi, Myo-Taeg LimCVPR 2024
- Adversarial Style Augmentation for Domain Generalized Urban-Scene SegmentationZhun Zhong, Yuyang Zhao, Gim Hee Lee, Nicu SebeNeurIPS 2022 · 130 citations
- Adaptive Texture Filtering for Single-Domain Generalized SegmentationXinhui Li, Mingjia Li, Yaxing Wang, Chuan-Xian Ren et al.AAAI 2023 · 9 citations
- RobustNet: Improving Domain Generalization in Urban-Scene Segmentation via Instance Selective WhiteningSungha Choi, Sanghun Jung, Huiwon Yun, Joanne Taery Kim et al.CVPR 2021
- Cross-View Regularization for Domain Adaptive Panoptic SegmentationJiaxing Huang, Dayan Guan, Aoran Xiao, Shijian LuCVPR 2021
