Contrastive Order Learning: A General Framework for Ordinal Regression
Chaewon Lee, BeomJun Shim, Kwang Choi, Chang-Su Kim
Abstract
We propose contrastive order learning (ConOrd), a contrastive learning framework for ordinal regression that integrates the strengths of contrastive learning and order learning. While contrastive learning effectively leverages all samples in a batch, it typically ignores the inherent ordering among rank labels. Conversely, order learning explicitly models label ordinality but often relies on local, margin-based comparisons, limiting its ability to capture global ordinal structure. ConOrd addresses these limitations by introducing a contrastive order loss with soft affinity and disparity weights based on rank differences, enabling fine-grained modeling of ordinal relationships across all sample pairs within a batch. Extensive experiments on a range of ordinal regression tasks, including facial age estimation, blind image quality assessment, and blind video quality assessment, demonstrate that ConOrd consistently achieves state-of-the-art performance and generalizes well across diverse ordinal regression scenarios. The source code is available at https://github.com/cwlee00/ConOrd .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 93d86b24-e259-4fba-8cf7-8b5b67553250Builds on42
- Learning Transferable Visual Models From Natural Language SupervisionAlec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh et al.ICML 2021 · 47,906 citations
- A Simple Framework for Contrastive Learning of Visual RepresentationsTing Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey E. HintonICML 2020 · 24,064 citations
- Supervised Contrastive LearningPrannay Khosla, Piotr Teterwak, Chen Wang, Aaron Sarna et al.NeurIPS 2020 · 7,049 citations
- Unsupervised Learning of Visual Features by Contrasting Cluster AssignmentsMathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal et al.NeurIPS 2020 · 5,249 citations
- SlowFast Networks for Video RecognitionChristoph Feichtenhofer, Haoqi Fan, Jitendra Malik, Kaiming HeICCV 2019 · 4,104 citations
Related papers
- Order Regularization on Ordinal Loss for Head Pose, Age and Gaze EstimationTianchu Guo, Hui Zhang, ByungIn Yoo, Yongchao Liu et al.AAAI 2021 · 11 citations
- Enhancing Contrastive Learning for Ordinal Regression via Ordinal Content Preserved Data AugmentationJiyang Zheng, Yu Yao, Bo Han, Dadong Wang et al.ICLR 2024 · 10 citations
- Unimodal-Concentrated Loss: Fully Adaptive Label Distribution Learning for Ordinal RegressionQiang Li, Jingjing Wang, Zhaoliang Yao, Yachun Li et al.CVPR 2022 · 27 citations
- OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal RegressionWanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang et al.NeurIPS 2022 · 65 citations
- Semi-Supervised Contrastive Learning for Deep Regression with Ordinal Rankings from Spectral SeriationWeihang Dai, Yao Du, Hanru Bai, Kwang-Ting Cheng et al.NeurIPS 2023 · 16 citations
