Quality-Agnostic Image Recognition via Invertible Decoder
Insoo Kim, Seungju Han, Ji-Won Baek, Seong-Jin Park, Jae-Joon Han, Jinwoo Shin
Abstract
Despite the remarkable performance of deep models on image recognition tasks, they are known to be susceptible to common corruptions such as blur, noise, and lowresolution. Data augmentation is a conventional way to build a robust model by considering these common corruptions during the training. However, a naive data augmentation scheme may result in a non-specialized model for particular corruptions, as the model tends to learn the averaged distribution among corruptions. To mitigate the issue, we propose a new paradigm of training deep image recognition networks that produce clean-like features from any quality image via an invertible neural architecture. The proposed method consists of two stages. In the first stage, we train an invertible network with only clean images under the recognition objective. In the second stage, its inversion, i.e., the invertible decoder, is attached to a new recognition network and we train this encoder-decoder network using both clean and corrupted images by considering recognition and reconstruction objectives. Our two-stage scheme allows the network to produce clean-like and robust features from any quality images, by reconstructing their clean images via the invertible decoder. We demonstrate the effectiveness of our method on image classification and face recognition tasks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 09b4de5c-fa31-4277-96dd-2f06673614f4Cited by top-tier papers10
- Pyramid Adversarial Training Improves ViT PerformanceCharles Herrmann, Kyle Sargent, Lu Jiang, Ramin Zabih et al.CVPR 2022 · 40 citations
- Learning Semantic Degradation-Aware Guidance for Recognition-Driven Unsupervised Low-Light Image EnhancementNaishan Zheng, Jie Huang, Man Zhou, Zizheng Yang et al.AAAI 2023 · 19 citations
- "It's trained by non-disabled people": Evaluating How Image Quality Affects Product Captioning with Vision-Language ModelsKapil Garg, Xinru Tang, Jimin Heo, Dwayne R. Morgan et al.CHI 2026 · 2 citations
- Vector Quantization with Self-Attention for Quality-Independent Representation LearningZhou Yang, Weisheng Dong, Xin Li, Mengluan Huang et al.CVPR 2023
- Gain from Neighbors: Boosting Model Robustness in the Wild via Adversarial Perturbations Toward Neighboring ClassesZhou Yang, Mingtao Feng, Tao Huang, Fangfang Wu et al.CVPR 2025
Builds on6
- The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution GeneralizationDan Hendrycks, Steven Basart, Norman Mu, Saurav Kadavath et al.ICCV 2021 · 2,294 citations
- AugMix: A Simple Data Processing Method to Improve Robustness and UncertaintyDan Hendrycks, Norman Mu, Ekin Dogus Cubuk, Barret Zoph et al.ICLR 2020 · 1,572 citations
- Similarity-Preserving Knowledge DistillationFrederick Tung, Greg MoriICCV 2019 · 1,214 citations
- Auxiliary Training: Towards Accurate and Robust ModelsLinfeng Zhang, Muzhou Yu, Tong Chen, Zuoqiang Shi et al.CVPR 2020
- Adversarial Examples Improve Image RecognitionCihang Xie, Mingxing Tan, Boqing Gong, Jiang Wang et al.CVPR 2020
Related papers
- Inverse Problems Leveraging Pre-trained Contrastive RepresentationsSriram Ravula, Georgios Smyrnis, Matt Jordan, Alexandros G. DimakisNeurIPS 2021 · 10 citations
- Improving robustness to corruptions with multiplicative weight perturbationsTrung Q. Trinh, Markus Heinonen, Luigi Acerbi, Samuel KaskiNeurIPS 2024 · 8 citations
- Visual Recognition-Driven Image Restoration for Multiple Degradation with Intrinsic Semantics RecoveryZizheng Yang, Jie Huang, Jiahao Chang, Man Zhou et al.CVPR 2023
- Improving robustness against common corruptions with frequency biased modelsTonmoy Saikia, Cordelia Schmid, Thomas BroxICCV 2021 · 51 citations
- Data augmentation for deep learning based accelerated MRI reconstruction with limited dataZalan Fabian, Reinhard Heckel, Mahdi SoltanolkotabiICML 2021 · 60 citations
