Bypassing the Transport Plan: Dynamic Reweighting for Out-of-Distribution Detection with Optimal Transport
Yang Xiao, Weiming Liu, Jun Dan, Tengyue Xu, Fan Wang, Hua Yu, Junhao Dong, Jiao Liu, Shunjie Dong, Lianyong Qi
Abstract
Semi-supervised learning (SSL) has achieved remarkable progress by leveraging both limited labeled data and abundant unlabeled data. However, unlabeled datasets often contain out-of-distribution (OOD) samples from unknown classes, which can lead to performance degradation in openset SSL scenarios. Current OOD detection methods are constrained by the absence of labeled OOD samples. Although optimal transport (OT) has proven to be effective to provide pseudo OOD scores for supervised learning, it still faces two main challenges, i.e., the unavoidable problem of finding the optimal transport plan and the unreliable OOD score caused by dense solutions. To overcome thess limitations, we propose a novel open-set OOD detection model named DREW, which leverages Dynamic REWeighting approach for OT-based OOD detection. Specifically, we start by formulating OOD detection as a semi-unbalanced optimal transport (SemiUOT) problem. The proposed DREW model can dynamically transform SemiUOT into the classical OT formula and then directly obtain the pseudo OOD score from the new source distribution weights. Contrary to existing OTbased OOD detection methods, the proposed DREW model provides theoretically grounded and more accurate pseudo OOD scores. Empirical results demonstrate the superiority of DREW in terms of both accuracy and efficiency.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext eecaf2a5-b97f-4fd7-825c-de143adbbe7dBuilds on31
- FixMatch: Simplifying Semi-Supervised Learning with Consistency and ConfidenceKihyuk Sohn, David Berthelot, Nicholas Carlini, Zizhao Zhang et al.NeurIPS 2020 · 5,129 citations
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 2,213 citations
- On the Importance of Gradients for Detecting Distributional Shifts in the WildRui Huang, Andrew Geng, Yixuan LiNeurIPS 2021 · 515 citations
- Safe Deep Semi-Supervised Learning for Unseen-Class Unlabeled DataLan-Zhe Guo, Zhenyu Zhang, Yuan Jiang, Yufeng Li et al.ICML 2020 · 243 citations
- SimMatch: Semi-supervised Learning with Similarity MatchingMingkai Zheng, Shan You, Lang Huang, Fei Wang et al.CVPR 2022 · 228 citations
Related papers
- STEP: Out-of-Distribution Detection in the Presence of Limited In-Distribution Labeled DataZhi Zhou, Lan-Zhe Guo, Zhanzhan Cheng, Yufeng Li et al.NeurIPS 2021 · 41 citations
- IOMatch: Simplifying Open-Set Semi-Supervised Learning with Joint Inliers and Outliers UtilizationZekun Li, Lei Qi, Yinghuan Shi, Yang GaoICCV 2023 · 47 citations
- Generative Modeling through the Semi-dual Formulation of Unbalanced Optimal TransportJaemoo Choi, Jaewoong Choi, Myungjoo KangNeurIPS 2023 · 46 citations
- Let the Void Be Void: Robust Open-Set Semi-Supervised Learning via Selective Non-AlignmentYou Rim Choi, Subeom Park, Seojun Heo, Eunchung Noh et al.AAAI 2026
- Uncertainty-Aware Optimal Transport for Semantically Coherent Out-of-Distribution DetectionFan Lu, Kai Zhu, Wei Zhai, Kecheng Zheng et al.CVPR 2023
