Revealing the Proximate Long-Tail Distribution in Compositional Zero-Shot Learning
Chenyi Jiang, Haofeng Zhang
Abstract
Compositional Zero-Shot Learning (CZSL) aims to transfer knowledge from seen state-object pairs to novel unseen pairs. In this process, visual bias caused by the diverse interrelationship of state-object combinations blurs their visual features, hindering the learning of distinguishable class prototypes. Prevailing methods concentrate on disentangling states and objects directly from visual features, disregarding potential enhancements that could arise from a data viewpoint. Experimentally, we unveil the results caused by the above problem closely approximate the long-tailed distribution. As a solution, we transform CZSL into a proximate class imbalance problem. We mathematically deduce the role of class prior within the long-tailed distribution in CZSL. Building upon this insight, we incorporate visual bias caused by compositions into the classifier's training and inference by estimating it as a proximate class prior. This enhancement encourages the classifier to acquire more discernible class prototypes for each composition, thereby achieving more balanced predictions. Experimental results demonstrate that our approach elevates the model's performance to the state-of-the-art level, without introducing additional parameters. Our code is available at https://github.com/LanchJL/ProLT-CZSL .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 5482fa2b-a84a-46f0-a400-4ce876720169Cited by top-tier papers6
- Compositional Zero-shot Learning via Progressive Language-based ObservationsLin Li, Guikun Chen, Zhen Wang, Jun Xiao et al.ACM MM 2025 · 2 citations
- A Conditional Probability Framework for Compositional Zero-Shot LearningPeng Wu, Qiuxia Lai, Hao Fang, Guo-Sen Xie et al.ICCV 2025 · 2 citations
- Learning Visual Proxy for Compositional Zero-Shot LearningShiyu Zhang, Cheng Yan, Yang Liu, Chenchen Jing et al.ICCV 2025 · 1 citation
- Compositional Zero-Shot Learning with Contextualized Cues and Adaptive Contrastive TrainingYun Li, Lina Yao, Zhe LiuACM MM 2025
- Learning Clustering-based Prototypes for Compositional Zero-Shot LearningHongyu Qu, Jianan Wei, Xiangbo Shu, Wenguan WangICLR 2025
Builds on15
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Task-Driven Modular Networks for Zero-Shot Compositional LearningSenthil Purushwalkam, Maximilian Nickel, Abhinav Gupta, Marc'Aurelio RanzatoICCV 2019 · 222 citations
- A causal view of compositional zero-shot recognitionYuval Atzmon, Felix Kreuk, Uri Shalit, Gal ChechikNeurIPS 2020 · 163 citations
- Siamese Contrastive Embedding Network for Compositional Zero-Shot LearningXiangyu Li, Xu Yang, Kun Wei, Cheng Deng et al.CVPR 2022 · 87 citations
Related papers
- Hierarchical Visual Primitive Experts for Compositional Zero-Shot LearningHanjae Kim, Jiyoung Lee, Seongheon Park, Kwanghoon SohnICCV 2023 · 27 citations
- TOMCAT: Test-time Comprehensive Knowledge Accumulation for Compositional Zero-Shot LearningXudong Yan, Songhe FengNeurIPS 2025
- Leveraging Sub-class Discimination for Compositional Zero-Shot LearningXiaoming Hu, Zilei WangAAAI 2023 · 21 citations
- Distilled Reverse Attention Network for Open-world Compositional Zero-Shot LearningYun Li, Zhe Liu, Saurav Jha, Lina YaoICCV 2023 · 23 citations
- Learning Attention as Disentangler for Compositional Zero-Shot LearningShaozhe Hao, Kai Han, Kwan-Yee K. WongCVPR 2023
