Topological Structure Learning for Weakly-Supervised Out-of-Distribution Detection
Rundong He, Rongxue Li, Zhongyi Han, Xihong Yang, Yilong Yin
Abstract
Out-of-distribution (OOD) detection is the key to deploying models safely in the open world. For OOD detection, collecting sufficient in-distribution (ID) labeled data is usually more time-consuming and costly than unlabeled data. When ID labeled data is limited, the previous OOD detection methods are no longer superior due to their high dependence on the amount of ID labeled data. Based on limited ID labeled data and sufficient unlabeled data, we define a new setting called Weakly-Supervised Out-of-Distribution Detection (WSOOD). To solve the new problem, we propose an effective method called Topological Structure Learning (TSL). Firstly, TSL uses a contrastive learning method to build the initial topological structure space for ID and OOD data. Secondly, TSL mines effective topological connections in the initial topological space. Finally, based on limited ID labeled data and mined topological connections, TSL reconstructs the topological structure in a new topological space to increase the separability of ID and OOD instances. Extensive studies on several representative datasets show that TSL remarkably outperforms the state-of-the-art, verifying the validity and robustness of our method in the new setting of WSOOD.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 87d2426d-ecc6-47fc-a7e0-1f97ca7ac789Cited by top-tier papers2
- How Does Unlabeled Data Provably Help Out-of-Distribution Detection?Xuefeng Du, Zhen Fang, Ilias Diakonikolas, Yixuan LiICLR 2024 · 39 citations
- When and How Does In-Distribution Label Help Out-of-Distribution Detection?Xuefeng Du, Yiyou Sun, Yixuan LiICML 2024 · 11 citations
Builds on15
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 2,213 citations
- CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted InstancesJihoon Tack, Sangwoo Mo, Jongheon Jeong, Jinwoo ShinNeurIPS 2020 · 755 citations
- Provable Guarantees for Self-Supervised Deep Learning with Spectral Contrastive LossJeff Z. HaoChen, Colin Wei, Adrien Gaidon, Tengyu MaNeurIPS 2021 · 425 citations
- VOS: Learning What You Don't Know by Virtual Outlier SynthesisXuefeng Du, Zhaoning Wang, Mu Cai, Yixuan LiICLR 2022 · 417 citations
Related papers
- STEP: Out-of-Distribution Detection in the Presence of Limited In-Distribution Labeled DataZhi Zhou, Lan-Zhe Guo, Zhanzhan Cheng, Yufeng Li et al.NeurIPS 2021 · 41 citations
- Graph Out-of-Distribution Detection Goes Neighborhood ShapingTianyi Bao, Qitian Wu, Zetian Jiang, Yiting Chen et al.ICML 2024 · 11 citations
- SSD: A Unified Framework for Self-Supervised Outlier DetectionVikash Sehwag, Mung Chiang, Prateek MittalICLR 2021 · 410 citations
- Let the Void Be Void: Robust Open-Set Semi-Supervised Learning via Selective Non-AlignmentYou Rim Choi, Subeom Park, Seojun Heo, Eunchung Noh et al.AAAI 2026
- Exploiting Mixed Unlabeled Data for Detecting Samples of Seen and Unseen Out-of-Distribution ClassesYi-Xuan Sun, Wei WangAAAI 2022 · 5 citations
