Data Augmentation for Meta-Learning
Renkun Ni, Micah Goldblum, Amr Sharaf, Kezhi Kong, Tom Goldstein
Abstract
Conventional image classifiers are trained by randomly sampling mini-batches of images. To achieve state-of-the-art performance, practitioners use sophisticated data augmentation schemes to expand the amount of training data available for sampling. In contrast, meta-learning algorithms sample support data, query data, and tasks on each training step. In this complex sampling scenario, data augmentation can be used not only to expand the number of images available per class, but also to generate entirely new classes/tasks. We systematically dissect the meta-learning pipeline and investigate the distinct ways in which data augmentation can be integrated at both the image and class levels. Our proposed meta-specific data augmentation significantly improves the performance of meta-learners on few-shot classification benchmarks.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eb30b0c1-bf00-4e61-9251-6a5f9219f667Cited by top-tier papers18
- Adversarially Robust Few-Shot Learning: A Meta-Learning ApproachMicah Goldblum, Liam Fowl, Tom GoldsteinNeurIPS 2020 · 107 citations
- C-Mixup: Improving Generalization in RegressionHuaxiu Yao, Yiping Wang, Linjun Zhang, James Y. Zou et al.NeurIPS 2022 · 106 citations
- Meta-Learning with Fewer Tasks through Task InterpolationHuaxiu Yao, Linjun Zhang, Chelsea FinnICLR 2022 · 66 citations
- MAML and ANIL Provably Learn RepresentationsLiam Collins, Aryan Mokhtari, Sewoong Oh, Sanjay ShakkottaiICML 2022 · 38 citations
- On sensitivity of meta-learning to support dataMayank Agarwal, Mikhail Yurochkin, Yuekai SunNeurIPS 2021 · 26 citations
Builds on5
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few ExamplesEleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin et al.ICLR 2020 · 692 citations
- Meta-Learning without MemorizationMingzhang Yin, George Tucker, Mingyuan Zhou, Sergey Levine et al.ICLR 2020 · 201 citations
- Meta-Learning Requires Meta-AugmentationJanarthanan Rajendran, Alexander Irpan, Eric JangNeurIPS 2020 · 111 citations
- Unraveling Meta-Learning: Understanding Feature Representations for Few-Shot TasksMicah Goldblum, Steven Reich, Liam Fowl, Renkun Ni et al.ICML 2020 · 82 citations
Related papers
- Adversarial Task Up-sampling for Meta-learningYichen Wu, Long-Kai Huang, Ying WeiNeurIPS 2022 · 18 citations
- Regularizing Neural Networks with Meta-Learning Generative ModelsShin'ya Yamaguchi, Daiki Chijiwa, Sekitoshi Kanai, Atsutoshi Kumagai et al.NeurIPS 2023 · 10 citations
- Attentive Weights Generation for Few Shot Learning via Information MaximizationYiluan Guo, Ngai-Man CheungCVPR 2020
- Unsupervised Meta-Learning through Latent-Space Interpolation in Generative ModelsSiavash Khodadadeh, Sharare Zehtabian, Saeed Vahidian, Weijia Wang et al.ICLR 2021 · 40 citations
- How to Train Your MAML to Excel in Few-Shot ClassificationHan-Jia Ye, Wei-Lun ChaoICLR 2022 · 61 citations
