Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Models
Siavash Khodadadeh, Sharare Zehtabian, Saeed Vahidian, Weijia Wang, Bill Lin, Ladislau Bölöni
Abstract
Unsupervised meta-learning approaches rely on synthetic meta-tasks that are created using techniques such as random selection, clustering and/or augmentation. Unfortunately, clustering and augmentation are domain-dependent, and thus they require either manual tweaking or expensive learning. In this work, we describe an approach that generates meta-tasks using generative models. A critical component is a novel approach of sampling from the latent space that generates objects grouped into synthetic classes forming the training and validation data of a meta-task. We find that the proposed approach, LAtent Space Interpolation Unsupervised Meta-learning (LASIUM), outperforms or is competitive with current unsupervised learning baselines on few-shot classification tasks on the most widely used benchmark datasets. In addition, the approach promises to be applicable without manual tweaking over a wider range of domains than previous approaches.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers8
- On the Importance of Distractors for Few-Shot ClassificationRajshekhar Das, Yu-Xiong Wang, José M. F. MouraICCV 2021 · 36 citations
- AID: Attention Interpolation of Text-to-Image DiffusionQiyuan He, Jinghao Wang, Ziwei Liu, Angela YaoNeurIPS 2024 · 30 citations
- CMVAE: Causal Meta VAE for Unsupervised Meta-LearningGuodong Qi, Huimin YuAAAI 2023 · 11 citations
- BECLR: Batch Enhanced Contrastive Few-Shot LearningStylianos Poulakakis-Daktylidis, Hadi Jamali RadICLR 2024 · 10 citations
- Unsupervised Meta-learning via Few-shot Pseudo-supervised Contrastive LearningHuiwon Jang, Hankook Lee, Jinwoo ShinICLR 2023 · 5 citations
Related papers
- Adversarial Task Up-sampling for Meta-learningYichen Wu, Long-Kai Huang, Ying WeiNeurIPS 2022 · 18 citations
- Data Augmentation for Meta-LearningRenkun Ni, Micah Goldblum, Amr Sharaf, Kezhi Kong et al.ICML 2021 · 93 citations
- Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-LearningDong Bok Lee, Dongchan Min, Seanie Lee, Sung Ju HwangICLR 2021 · 62 citations
- Constructing Multiple Tasks for Augmentation: Improving Neural Image Classification with K-Means FeaturesTao Gui, Lizhi Qing, Qi Zhang, Jiacheng Ye et al.AAAI 2020 · 2 citations
- Interval Bound Interpolation for Few-shot Learning with Few TasksShounak Datta, Sankha Subhra Mullick, Anish Chakrabarty, Swagatam DasICML 2023 · 4 citations
