Self-Supervised Domain-Aware Generative Network for Generalized Zero-Shot Learning
Jiamin Wu, Tianzhu Zhang, Zheng-Jun Zha, Jiebo Luo, Yongdong Zhang, Feng Wu
Abstract
Generalized Zero-Shot Learning (GZSL) aims at recognizing both seen and unseen classes by constructing correspondence between visual and semantic embedding. However, existing methods have severely suffered from the strong bias problem, where unseen instances in target domain tend to be recognized as seen classes in source domain. To address this issue, we propose an end-to-end Self-supervised Domain-aware Generative Network (SDGN) by integrating self-supervised learning into feature generating model for unbiased GZSL. The proposed SDGN model enjoys several merits. First, we design a cross-domain feature generating module to synthesize samples with high fidelity based on class embeddings, which involves a novel target domain discriminator to preserve the domain consistency. Second, we propose a self-supervised learning module to investigate inter-domain relationships, where a set of anchors are introduced as a bridge between seen and unseen categories. In the shared space, we pull the distribution of target domain away from source domain, and obtain domain-aware features with high discriminative power for both seen and unseen classes. To our best knowledge, this is the first work to introduce self-supervised learning into GZSL as a learning guidance. Extensive experimental results on five standard benchmarks demonstrate that our model performs favorably against state-of-the-art GZSL methods.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext a9f2ec86-905d-4ec3-bd08-3a68789a3562Cited by top-tier papers11
- FREE: Feature Refinement for Generalized Zero-Shot LearningShiming Chen, Wenjie Wang, Beihao Xia, Qinmu Peng et al.ICCV 2021 · 171 citations
- Synthesized Feature based Few-Shot Class-Incremental Learning on a Mixture of SubspacesAli Cheraghian, Shafin Rahman, Sameera Ramasinghe, Pengfei Fang et al.ICCV 2021 · 81 citations
- Robust Region Feature Synthesizer for Zero-Shot Object DetectionPeiliang Huang, Junwei Han, De Cheng, Dingwen ZhangCVPR 2022 · 50 citations
- Cross-Trajectory Representation Learning for Zero-Shot Generalization in RLBogdan Mazoure, Ahmed M. Ahmed, R. Devon Hjelm, Andrey Kolobov et al.ICLR 2022 · 30 citations
- Reformulating Zero-shot Action Recognition for Multi-label ActionsAlec Kerrigan, Kevin Duarte, Yogesh S. Rawat, Mubarak ShahNeurIPS 2021 · 23 citations
Builds on2
Related papers
- A Variational Autoencoder with Deep Embedding Model for Generalized Zero-Shot LearningPeirong Ma, Xiao HuAAAI 2020 · 43 citations
- Task-Independent Knowledge Makes for Transferable Representations for Generalized Zero-Shot LearningChaoqun Wang, Xuejin Chen, Shaobo Min, Xiaoyan Sun et al.AAAI 2021 · 22 citations
- Adaptive and Generative Zero-Shot LearningYu-Ying Chou, Hsuan-Tien Lin, Tyng-Luh LiuICLR 2021 · 25 citations
- Semantic-guided Reinforced Region Embedding for Generalized Zero-Shot LearningJiannan Ge, Hongtao Xie, Shaobo Min, Yongdong ZhangAAAI 2021 · 36 citations
- Contrastive Embedding for Generalized Zero-Shot LearningZongyan Han, Zhenyong Fu, Shuo Chen, Jian YangCVPR 2021
