Adversarially Robust Few-Shot Learning: A Meta-Learning Approach
Micah Goldblum, Liam Fowl, Tom Goldstein
Abstract
Previous work on adversarially robust neural networks for image classification requires large training sets and computationally expensive training procedures. On the other hand, few-shot learning methods are highly vulnerable to adversarial examples. The goal of our work is to produce networks which both perform well at few-shot classification tasks and are simultaneously robust to adversarial examples. We develop an algorithm, called Adversarial Querying (AQ), for producing adversarially robust meta-learners, and we thoroughly investigate the causes for adversarial vulnerability. Moreover, our method achieves far superior robust performance on few-shot image classification tasks, such as Mini-ImageNet and CIFAR-FS, than robust transfer learning.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9fe5c79-d1f8-4665-b69e-c6f4e7fe7feeCited by top-tier papers25
- Adversarially Robust DistillationMicah Goldblum, Liam Fowl, Soheil Feizi, Tom GoldsteinAAAI 2020 · 258 citations
- Sharp-MAML: Sharpness-Aware Model-Agnostic Meta LearningMomin Abbas, Quan Xiao, Lisha Chen, Pin-Yu Chen et al.ICML 2022 · 105 citations
- Generalized and Discriminative Few-Shot Object Detection via SVD-Dictionary EnhancementAming Wu, Suqi Zhao, Cheng Deng, Wei LiuNeurIPS 2021 · 52 citations
- Few-Shot Adversarial Prompt Learning on Vision-Language ModelsYiwei Zhou, Xiaobo Xia, Zhiwei Lin, Bo Han et al.NeurIPS 2024 · 48 citations
- Few-shot Learning with Noisy LabelsKevin J. Liang, Samrudhdhi B. Rangrej, Vladan Petrovic, Tal HassnerCVPR 2022 · 46 citations
Builds on4
- Adversarially robust transfer learningAli Shafahi, Parsa Saadatpanah, Chen Zhu, Amin Ghiasi et al.ICLR 2020 · 130 citations
- Data Augmentation for Meta-LearningRenkun Ni, Micah Goldblum, Amr Sharaf, Kezhi Kong et al.ICML 2021 · 93 citations
- Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot TasksMicah Goldblum, Steven Reich, Liam Fowl, Renkun Ni et al.ICML 2020 · 82 citations
- Adversarial Attacks on Copyright Detection SystemsParsa Saadatpanah, Ali Shafahi, Tom GoldsteinICML 2020 · 38 citations
Related papers
- Improving Adversarially Robust Few-shot Image Classification with Generalizable RepresentationsJunhao Dong, Yuan Wang, Jianhuang Lai, Xiaohua XieCVPR 2022 · 30 citations
- Meta-Attack: Class-agnostic and Model-agnostic Physical Adversarial AttackWeiwei Feng, Baoyuan Wu, Tianzhu Zhang, Yong Zhang et al.ICCV 2021 · 35 citations
- On Fast Adversarial Robustness Adaptation in Model-Agnostic Meta-LearningRen Wang, Kaidi Xu, Sijia Liu, Pin-Yu Chen et al.ICLR 2021 · 17 citations
- A Theoretical Analysis of the Number of Shots in Few-Shot LearningTianshi Cao, Marc T. Law, Sanja FidlerICLR 2020 · 75 citations
- Meta Variance Transfer: Learning to Augment from the OthersSeong-Jin Park, Seungju Han, Ji-Won Baek, Insoo Kim et al.ICML 2020 · 55 citations
