Does enhanced shape bias improve neural network robustness to common corruptions?
Chaithanya Kumar Mummadi, Ranjitha Subramaniam, Robin Hutmacher, Julien Vitay, Volker Fischer, Jan Hendrik Metzen
摘要
Convolutional neural networks (CNNs) learn to extract representations of complex features, such as object shapes and textures to solve image recognition tasks. Recent work indicates that CNNs trained on ImageNet are biased towards features that encode textures and that these alone are sufficient to generalize to unseen test data from the same distribution as the training data but often fail to generalize to out-of-distribution data. It has been shown that augmenting the training data with different image styles decreases this texture bias in favor of increased shape bias while at the same time improving robustness to common corruptions, such as noise and blur. Commonly, this is interpreted as shape bias increasing corruption robustness. However, this relationship is only hypothesized. We perform a systematic study of different ways of composing inputs based on natural images, explicit edge information, and stylization. While stylization is essential for achieving high corruption robustness, we do not find a clear correlation between shape bias and robustness. We conclude that the data augmentation caused by style-variation accounts for the improved corruption robustness and increased shape bias is only a byproduct.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper9
- Intriguing Properties of Vision TransformersMuzammal Naseer, Kanchana Ranasinghe, Salman Khan, Munawar Hayat 等NeurIPS 2021 · 被引用 863 次
- Robust Contrastive Learning Using Negative Samples with Diminished SemanticsSongwei Ge, Shlok Mishra, Chun-Liang Li, Haohan Wang 等NeurIPS 2021 · 被引用 81 次
- ImageNet-trained CNNs are not biased towards texture: Revisiting feature reliance through controlled suppressionTom Burgert, Oliver Stoll, Paolo Rota, Begüm DemirNeurIPS 2025 · 被引用 19 次
- Geometric and Textural Augmentation for Domain Gap ReductionXiao-Chang Liu, Yongliang Yang, Peter HallCVPR 2022 · 被引用 16 次
- Visual Data Diagnosis and Debiasing with Concept GraphsRwiddhi Chakraborty, Yinong Wang, Jialu Gao, Runkai Zheng 等NeurIPS 2024 · 被引用 9 次
它引用的顶会 Paper5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh 等ICCV 2019 · 被引用 5,843 次
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath 等ICCV 2021 · 被引用 2,294 次
- Informative Dropout for Robust Representation Learning: A Shape-bias PerspectiveBaifeng Shi, Dinghuai Zhang, Qi Dai, Zhanxing Zhu 等ICML 2020 · 被引用 122 次
- On Feature Normalization and Data AugmentationBoyi Li, Felix Wu, Ser-Nam Lim, Serge J. Belongie 等CVPR 2021
- Self-Training With Noisy Student Improves ImageNet ClassificationQizhe Xie, Minh-Thang Luong, Eduard H. Hovy, Quoc V. LeCVPR 2020
相关 Paper
- The Origins and Prevalence of Texture Bias in Convolutional Neural NetworksKatherine L. Hermann, Ting Chen, Simon KornblithNeurIPS 2020 · 被引用 369 次
- Shape-Texture Debiased Neural Network TrainingYingwei Li, Qihang Yu, Mingxing Tan, Jieru Mei 等ICLR 2021 · 被引用 128 次
- Shape or Texture: Understanding Discriminative Features in CNNsMd. Amirul Islam, Matthew Kowal, Patrick Esser, Sen Jia 等ICLR 2021 · 被引用 86 次
- Edges to Shapes to Concepts: Adversarial Augmentation for Robust VisionAditay Tripathi, Rishubh Singh, Anirban Chakraborty, Pradeep ShenoyCVPR 2023
- Robust and Generalizable Visual Representation Learning via Random ConvolutionsZhenlin Xu, Deyi Liu, Junlin Yang, Colin Raffel 等ICLR 2021 · 被引用 268 次
