Creativity Inspired Zero-Shot Learning
Mohamed Elhoseiny, Mohamed Elfeki
Abstract
Zero-shot learning (ZSL) aims at understanding unseen categories with no training examples from class-level descriptions. To improve the discriminative power of zeroshot learning, we model the visual learning process of unseen categories with an inspiration from the psychology of human creativity for producing novel art. We relate ZSL to human creativity by observing that zero-shot learning is about recognizing the unseen and creativity is about creating a likable unseen. We introduce a learning signal inspired by creativity literature that explores the unseen space with hallucinated class-descriptions and encourages careful deviation of their visual feature generations from seen classes while allowing knowledge transfer from seen to unseen classes. Empirically, we show consistent improvement over the state of the art of several percents on the largest available benchmarks on the challenging task or generalized ZSL from a noisy text that we focus on, using the CUB and NABirds datasets. We also show the advantage of our approach on Attribute-based ZSL on three additional datasets (AwA2, aPY, and SUN). Code is available at https://github.com/mhelhoseiny/CIZSL .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext f173ebaf-06af-4271-a900-42ef78cd0b58Cited by top-tier papers8
- Class Normalization for (Continual)? Generalized Zero-Shot LearningIvan Skorokhodov, Mohamed ElhoseinyICLR 2021 · 51 citations
- Towards Novel Target Discovery Through Open-Set Domain AdaptationTaotao Jing, Hongfu Liu, Zhengming DingICCV 2021 · 40 citations
- Rethinking Generative Zero-Shot Learning: An Ensemble Learning Perspective for Recognising Visual PatchesZhi Chen, Sen Wang, Jingjing Li, Zi HuangACM MM 2020 · 33 citations
- Continual Zero-Shot Learning through Semantically Guided Generative Random WalksWenxuan Zhang, Paul Janson, Kai Yi, Ivan Skorokhodov et al.ICCV 2023 · 5 citations
- Inspiration Seeds: Learning Non-Literal Visual Combinations for Generative ExplorationKfir Goldberg, Elad Richardson, Yael VinkerSIGGRAPH 2026 · 1 citation
Related papers
- Rethinking Zero-Shot Learning: A Conditional Visual Classification PerspectiveKai Li, Martin Renqiang Min, Yun FuICCV 2019 · 151 citations
- Generalized Zero-Shot Learning via Disentangled RepresentationXiangyu Li, Zhe Xu, Kun Wei, Cheng DengAAAI 2021 · 88 citations
- Goal-Oriented Gaze Estimation for Zero-Shot LearningYang Liu, Lei Zhou, Xiao Bai, Yifei Huang et al.CVPR 2021
- Adaptive and Generative Zero-Shot LearningYu-Ying Chou, Hsuan-Tien Lin, Tyng-Luh LiuICLR 2021 · 25 citations
- VGSE: Visually-Grounded Semantic Embeddings for Zero-Shot LearningWenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele et al.CVPR 2022 · 61 citations
