Meta-Learning for Generalized Zero-Shot Learning
Vinay Kumar Verma, Dhanajit Brahma, Piyush Rai
Abstract
Learning to classify unseen class samples at test time is popularly referred to as zero-shot learning (ZSL). If test samples can be from training (seen) as well as unseen classes, it is a more challenging problem due to the existence of strong bias towards seen classes. This problem is generally known as generalized zero-shot learning (GZSL). Thanks to the recent advances in generative models such as VAEs and GANs, sample synthesis based approaches have gained considerable attention for solving this problem. These approaches are able to handle the problem of class bias by synthesizing unseen class samples. However, these ZSL/GZSL models suffer due to the following key limitations: (i) Their training stage learns a class-conditioned generator using only seen class data and the training stage does not explicitly learn to generate the unseen class samples; (ii) They do not learn a generic optimal parameter which can easily generalize for both seen and unseen class generation; and (iii) If we only have access to a very few samples per seen class, these models tend to perform poorly. In this paper, we propose a meta-learning based generative model that naturally handles these limitations. The proposed model is based on integrating model-agnostic meta learning with a Wasserstein GAN (WGAN) to handle (i) and (iii), and uses a novel task distribution to handle (ii). Our proposed model yields significant improvements on standard ZSL as well as more challenging GZSL setting. In ZSL setting, our model yields 4.5%, 6.0%, 9.8%, and 27.9% relative improvements over the current state-of-the-art on CUB, AWA1, AWA2, and aPY datasets, respectively.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 6b964731-e54c-4b8b-8412-4276774f9df1Cited by top-tier papers15
- En-Compactness: Self-Distillation Embedding & Contrastive Generation for Generalized Zero-Shot LearningXia Kong, Zuodong Gao, Xiaofan Li, Ming Hong et al.CVPR 2022 · 70 citations
- Class Normalization for (Continual)? Generalized Zero-Shot LearningIvan Skorokhodov, Mohamed ElhoseinyICLR 2021 · 51 citations
- Task Aligned Generative Meta-learning for Zero-shot LearningZhe Liu, Yun Li, Lina Yao, Xianzhi Wang et al.AAAI 2021 · 45 citations
- Boosting Generative Zero-Shot Learning by Synthesizing Diverse Features with Attribute AugmentationXiaojie Zhao, Yuming Shen, Shidong Wang, Haofeng ZhangAAAI 2022 · 34 citations
- Adaptive and Generative Zero-Shot LearningYu-Ying Chou, Hsuan-Tien Lin, Tyng-Luh LiuICLR 2021 · 25 citations
Related papers
- Generalized Zero-Shot Learning using Generated Proxy Unseen Samples and Entropy SeparationOmkar Gune, Biplab Banerjee, Subhasis Chaudhuri, Fabio CuzzolinACM MM 2020 · 15 citations
- MetaZSCIL: A Meta-Learning Approach for Generalized Zero-Shot Class Incremental LearningYanan Wu, Tengfei Liang, Songhe Feng, Yi Jin et al.AAAI 2023 · 8 citations
- Non-generative Generalized Zero-shot Learning via Task-correlated Disentanglement and Controllable Samples SynthesisYaogong Feng, Xiaowen Huang, Pengbo Yang, Jian Yu et al.CVPR 2022 · 5 citations
- A Variational Autoencoder with Deep Embedding Model for Generalized Zero-Shot LearningPeirong Ma, Xiao HuAAAI 2020 · 43 citations
- Deconstructed Generation-Based Zero-Shot ModelDubing Chen, Yuming Shen, Haofeng Zhang, Philip H. S. TorrAAAI 2023 · 8 citations
