DARL: Mitigating Gradient Conflicts in Long-Tailed Out-of-Distribution Learning
Xuan Zhang, Sin Chee Chin, Jing-Hao Xue, Xiaochen Yang, Wenming Yang
Abstract
Long-tailed out-of-distribution learning aims to reduce performance bias in long-tailed in-distribution (ID) data while rejecting out-of-distribution (OOD) samples, which are often mistaken for under-represented tail classes. To achieve OOD detection, existing methods incorporate an outlier exposure (OE) term into the long-tailed recognition (LTR) loss. However, as we prove in this paper, the OE term induces a gradient conflict with the ID objectives, especially for tail classes, thereby contradicting the core motivation of LTR. To avoid the ID-OOD dilemma, we propose Dynamic Ambiguity-aware Recalibration for Logits (DARL), an ambiguity-guided long-tailed OOD learning approach, grounded on two theoretical insights. First, we show that the mixed ID data can mitigate the conflict in OE training and exhibits higher intrinsic ambiguity than the original ID data, thus able to serve as a surrogate for real OOD data. Second, we introduce an ambiguity-aware logit adjustment that can dynamically calibrate the class margins using energy-based ambiguity metrics, effectively reducing early-stage bias while avoiding late-stage overfitting. Extensive experiments show that DARL achieves the overall state-of-the-art performance of long-tailed OOD learning. Moreover, compared with the OE methods, DARL trains solely on the ID data, which can reduce the data requirements by 80%. The code is available in https://github.com/XuanZhang-A/DARL.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 2fdaf8fd-5e0f-438d-b5b8-3225bb18451dCited by top-tier papers1
Ask how each one uses itBuilds on33
- CutMix: Regularization Strategy to Train Strong Classifiers With Localizable FeaturesSangdoo Yun, Dongyoon Han, Sanghyuk Chun, Seong Joon Oh et al.ICCV 2019 · 5,843 citations
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 2,213 citations
- Decoupling Representation and Classifier for Long-Tailed RecognitionBingyi Kang, Saining Xie, Marcus Rohrbach, Zhicheng Yan et al.ICLR 2020 · 1,496 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Balanced Meta-Softmax for Long-Tailed Visual RecognitionJiawei Ren, Cunjun Yu, Shunan Sheng, Xiao Ma et al.NeurIPS 2020 · 861 citations
Related papers
- Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class LearningWenjun Miao, Guansong Pang, Xiao Bai, Tianqi Li et al.AAAI 2024 · 31 citations
- Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution AdaptationWenjun Miao, Guansong Pang, Jin Zheng, Xiao BaiNeurIPS 2024 · 12 citations
- EAT: Towards Long-Tailed Out-of-Distribution DetectionTong Wei, Bo-Lin Wang, Min-Ling ZhangAAAI 2024 · 21 citations
- Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to TailYina He, Lei Peng, Yongcun Zhang, Juanjuan Weng et al.AAAI 2025 · 5 citations
- Long-Tailed Recognition by Mutual Information Maximization between Latent Features and Ground-Truth LabelsMin-Kook Suh, Seung-Woo SeoICML 2023 · 30 citations
