Does enhanced shape bias improve neural network robustness to common corruptions?
Chaithanya Kumar Mummadi, Ranjitha Subramaniam, Robin Hutmacher, Julien Vitay, Volker Fischer, Jan Hendrik Metzen
Abstract
Convolutional neural networks (CNNs) learn to extract representations of complex features, such as object shapes and textures to solve image recognition tasks. Recent work indicates that CNNs trained on ImageNet are biased towards features that encode textures and that these alone are sufficient to generalize to unseen test data from the same distribution as the training data but often fail to generalize to out-of-distribution data. It has been shown that augmenting the training data with different image styles decreases this texture bias in favor of increased shape bias while at the same time improving robustness to common corruptions, such as noise and blur. Commonly, this is interpreted as shape bias increasing corruption robustness. However, this relationship is only hypothesized. We perform a systematic study of different ways of composing inputs based on natural images, explicit edge information, and stylization. While stylization is essential for achieving high corruption robustness, we do not find a clear correlation between shape bias and robustness. We conclude that the data augmentation caused by style-variation accounts for the improved corruption robustness and increased shape bias is only a byproduct.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers9
- Intriguing Properties of Vision TransformersMuzammal Naseer, Kanchana Ranasinghe, Salman Khan, Munawar Hayat et al.NeurIPS 2021 · 863 citations
- Robust Contrastive Learning Using Negative Samples with Diminished SemanticsSongwei Ge, Shlok Mishra, Chun-Liang Li, Haohan Wang et al.NeurIPS 2021 · 81 citations
- ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppressionTom Burgert, Oliver Stoll, Paolo Rota, Begüm DemirNeurIPS 2025 · 19 citations
- Geometric and Textural Augmentation for Domain Gap ReductionXiao-Chang Liu, Yongliang Yang, Peter HallCVPR 2022 · 16 citations
- Visual Data Diagnosis and Debiasing with Concept GraphsRwiddhi Chakraborty, Yinong Wang, Jialu Gao, Runkai Zheng et al.NeurIPS 2024 · 9 citations
Builds on5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- Informative Dropout for Robust Representation Learning: A Shape-bias PerspectiveBaifeng Shi, Dinghuai Zhang, Qi Dai, Zhanxing Zhu et al.ICML 2020 · 122 citations
- On Feature Normalization and Data AugmentationBoyi Li, Felix Wu, Ser-Nam Lim, Serge J. Belongie et al.CVPR 2021
- Self-Training With Noisy Student Improves ImageNet ClassificationQizhe Xie, Minh-Thang Luong, Eduard H. Hovy, Quoc V. LeCVPR 2020
Related papers
- The Origins and Prevalence of Texture Bias in Convolutional Neural NetworksKatherine L. Hermann, Ting Chen, Simon KornblithNeurIPS 2020 · 369 citations
- Shape-Texture Debiased Neural Network TrainingYingwei Li, Qihang Yu, Mingxing Tan, Jieru Mei et al.ICLR 2021 · 128 citations
- Shape or Texture: Understanding Discriminative Features in CNNsMd. Amirul Islam, Matthew Kowal, Patrick Esser, Sen Jia et al.ICLR 2021 · 86 citations
- Edges to Shapes to Concepts: Adversarial Augmentation for Robust VisionAditay Tripathi, Rishubh Singh, Anirban Chakraborty, Pradeep ShenoyCVPR 2023
- Robust and Generalizable Visual Representation Learning via Random ConvolutionsZhenlin Xu, Deyi Liu, Junlin Yang, Colin Raffel et al.ICLR 2021 · 268 citations
