Learning and Evaluating Representations for Deep One-Class Classification
Kihyuk Sohn, Chun-Liang Li, Jinsung Yoon, Minho Jin, Tomas Pfister
Abstract
We present a two-stage framework for deep one-class classification. We first learn self-supervised representations from one-class data, and then build one-class classifiers on learned representations. The framework not only allows to learn better representations, but also permits building one-class classifiers that are faithful to the target task. We argue that classifiers inspired by the statistical perspective in generative or discriminative models are more effective than existing approaches, such as a normality score from a surrogate classifier. We thoroughly evaluate different self-supervised representation learning algorithms under the proposed framework for one-class classification. Moreover, we present a novel distribution-augmented contrastive learning that extends training distributions via data augmentation to obstruct the uniformity of contrastive representations. In experiments, we demonstrate state-of-the-art performance on visual domain oneclass classification benchmarks, including novelty and anomaly detection. Finally, we present visual explanations, confirming that the decision-making process of deep one-class classifiers is intuitive to humans. The code is available at https: //github.com/google-research/deep_representation_one_class.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext b081047c-6b90-40ed-9d80-c8328948c71aCited by top-tier papers41
- Neural Transformation Learning for Deep Anomaly Detection Beyond ImagesChen Qiu, Timo Pfrommer, Marius Kloft, Stephan Mandt et al.ICML 2021 · 171 citations
- Catching Both Gray and Black Swans: Open-set Supervised Anomaly DetectionChoubo Ding, Guansong Pang, Chunhua ShenCVPR 2022 · 163 citations
- CrossCLR: Cross-modal Contrastive Learning For Multi-modal Video RepresentationsMohammadreza Zolfaghari, Yi Zhu, Peter V. Gehler, Thomas BroxICCV 2021 · 160 citations
- Deep One-Class Classification via Interpolated Gaussian DescriptorYuanhong Chen, Yu Tian, Guansong Pang, Gustavo CarneiroAAAI 2022 · 139 citations
- ReContrast: Domain-Specific Anomaly Detection via Contrastive ReconstructionJia Guo, Shuai Lu, Lize Jia, Weihang Zhang et al.NeurIPS 2023 · 124 citations
Builds on11
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Bootstrap Your Own Latent - A New Approach to Self-Supervised LearningJean-Bastien Grill, Florian Strub, Florent Altché, Corentin Tallec et al.NeurIPS 2020 · 9,171 citations
- Understanding Contrastive Representation Learning through Alignment and Uniformity on the HypersphereTongzhou Wang, Phillip IsolaICML 2020 · 2,360 citations
- Data-Efficient Image Recognition with Contrastive Predictive CodingOlivier J. HénaffICML 2020 · 1,553 citations
- CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted InstancesJihoon Tack, Sangwoo Mo, Jongheon Jeong, Jinwoo ShinNeurIPS 2020 · 755 citations
Related papers
- Rotation Has Two Sides: Evaluating Data Augmentation for Deep One-class ClassificationGuodong Wang, Yunhong Wang, Xiuguo Bao, Di HuangICLR 2024 · 3 citations
- CutPaste: Self-Supervised Learning for Anomaly Detection and LocalizationChun-Liang Li, Kihyuk Sohn, Jinsung Yoon, Tomas PfisterCVPR 2021
- DROCC: Deep Robust One-Class ClassificationSachin Goyal, Aditi Raghunathan, Moksh Jain, Harsha Vardhan Simhadri et al.ICML 2020 · 202 citations
- Mean-Shifted Contrastive Loss for Anomaly DetectionTal Reiss, Yedid HoshenAAAI 2023 · 153 citations
- Exploring Balanced Feature Spaces for Representation LearningBingyi Kang, Yu Li, Sa Xie, Zehuan Yuan et al.ICLR 2021 · 296 citations
