Balanced Energy Regularization Loss for Out-of-distribution Detection
Hyunjun Choi, Hawook Jeong, Jin Young Choi
Abstract
In the field of out-of-distribution (OOD) detection, a previous method that use auxiliary data as OOD data has shown promising performance. However, the method provides an equal loss to all auxiliary data to differentiate them from inliers. However, based on our observation, in various tasks, there is a general imbalance in the distribution of the auxiliary OOD data across classes. We propose a balanced energy regularization loss that is simple but generally effective for a variety of tasks. Our balanced energy regularization loss utilizes class-wise different prior probabilities for auxiliary data to address the class imbalance in OOD data. The main concept is to regularize auxiliary samples from majority classes, more heavily than those from minority classes. Our approach performs better for OOD detection in semantic segmentation, long-tailed image classification, and image classification than the prior energy regularization loss. Furthermore, our approach achieves state-of-the-art performance in two tasks: OOD detection in semantic segmentation and long-tailed image classification. Code is available at https://github.com/ hyunjunChhoi/Balanced_Energy
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Cited by top-tier papers14
- Out-of-Distribution Detection in Long-Tailed Recognition with Calibrated Outlier Class LearningWenjun Miao, Guansong Pang, Xiao Bai, Tianqi Li et al.AAAI 2024 · 31 citations
- Long-Tailed Out-of-Distribution Detection via Normalized Outlier Distribution AdaptationWenjun Miao, Guansong Pang, Jin Zheng, Xiao BaiNeurIPS 2024 · 12 citations
- Extremely Simple Multimodal Outlier Synthesis for Out-of-Distribution Detection and SegmentationMoru Liu, Hao Dong, Jessica Kelly, Olga Fink et al.NeurIPS 2025 · 12 citations
- Rethinking Out-of-Distribution Detection on Imbalanced Data DistributionKai Liu, Zhihang Fu, Sheng Jin, Chao Chen et al.NeurIPS 2024 · 9 citations
- LiON: Learning Point-Wise Abstaining Penalty for LiDAR Outlier DetectioN Using Diverse Synthetic DataShaocong Xu, Pengfei Li, Qianpu Sun, Xinyu Liu et al.AAAI 2025 · 6 citations
Builds on14
- Energy-based Out-of-distribution DetectionWeitang Liu, Xiaoyun Wang, John D. Owens, Yixuan LiNeurIPS 2020 · 2,213 citations
- Long-tail learning via logit adjustmentAditya Krishna Menon, Sadeep Jayasumana, Ankit Singh Rawat, Himanshu Jain et al.ICLR 2021 · 937 citations
- Scaling Out-of-Distribution Detection for Real-World SettingsDan Hendrycks, Steven Basart, Mantas Mazeika, Andy Zou et al.ICML 2022 · 653 citations
- Long-tailed Recognition by Routing Diverse Distribution-Aware ExpertsXudong Wang, Long Lian, Zhongqi Miao, Ziwei Liu et al.ICLR 2021 · 481 citations
- Detecting Out-of-Distribution Examples with Gram MatricesChandramouli Shama Sastry, Sageev OoreICML 2020 · 275 citations
Related papers
- Regularizing Energy among Training Samples for Out-of-Distribution GeneralizationYiting Chen, Qitian Wu, Junchi YanICLR 2025
- EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap ExpansionYuchen Sun, Qianqian Xu, Zitai Wang, Zhiyong Yang et al.AAAI 2025 · 1 citation
- InPL: Pseudo-labeling the Inliers First for Imbalanced Semi-supervised LearningZhuoran Yu, Yin Li, Yong Jae LeeICLR 2023
- Long-Tailed Out-of-Distribution Detection: Prioritizing Attention to TailYina He, Lei Peng, Yongcun Zhang, Juanjuan Weng et al.AAAI 2025 · 5 citations
- EAT: Towards Long-Tailed Out-of-Distribution DetectionTong Wei, Bo-Lin Wang, Min-Ling ZhangAAAI 2024 · 21 citations
