An Unbiased Risk Estimator for Learning with Augmented Classes
Yu-Jie Zhang, Peng Zhao, Lanjihong Ma, Zhi-Hua Zhou
Abstract
This paper studies the problem of learning with augmented classes (LAC), where augmented classes unobserved in the training data might emerge in the testing phase. Previous studies generally attempt to discover augmented classes by exploiting geometric properties, achieving inspiring empirical performance yet lacking theoretical understandings particularly on the generalization ability. In this paper we show that, by using unlabeled training data to approximate the potential distribution of augmented classes, an unbiased risk estimator of the testing distribution can be established for the LAC problem under mild assumptions, which paves a way to develop a sound approach with theoretical guarantees. Moreover, the proposed approach can adapt to complex changing environments where augmented classes may appear and the prior of known classes may change simultaneously. Extensive experiments confirm the effectiveness of our proposed approach.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 25782065-5493-4357-91b4-bc009e68f4d4Cited by top-tier papers14
- Adapting to Online Label Shift with Provable GuaranteesYong Bai, Yu-Jie Zhang, Peng Zhao, Masashi Sugiyama et al.NeurIPS 2022 · 43 citations
- Exploratory Machine Learning with Unknown UnknownsPeng Zhao, Yu-Jie Zhang, Zhi-Hua ZhouAAAI 2021 · 29 citations
- Towards Enabling Learnware to Handle Unseen JobsYu-Jie Zhang, Yu-Hu Yan, Peng Zhao, Zhi-Hua ZhouAAAI 2021 · 20 citations
- Identifying Useful Learnwares for Heterogeneous Label SpacesLan-Zhe Guo, Zhi Zhou, Yufeng Li, Zhi-Hua ZhouICML 2023 · 17 citations
- Enabling Knowledge Refinement upon New Concepts in Abductive LearningYu-Xuan Huang, Wang-Zhou Dai, Yuan Jiang, Zhi-Hua ZhouAAAI 2023 · 13 citations
Related papers
- A Generalized Unbiased Risk Estimator for Learning with Augmented ClassesSenlin Shu, Shuo He, Haobo Wang, Hongxin Wei et al.AAAI 2023 · 4 citations
- Open-World Semi-Supervised LearningKaidi Cao, Maria Brbic, Jure LeskovecICLR 2022 · 246 citations
- Adaptive Risk Minimization: Learning to Adapt to Domain ShiftMarvin Zhang, Henrik Marklund, Nikita Dhawan, Abhishek Gupta et al.NeurIPS 2021 · 284 citations
- OpenMix: Reviving Known Knowledge for Discovering Novel Visual Categories in an Open WorldZhun Zhong, Linchao Zhu, Zhiming Luo, Shaozi Li et al.CVPR 2021
- Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution ClassesYi-Xuan Sun, Wei WangAAAI 2022 · 5 citations
