GoR: A Unified and Extensible Generative Framework for Ordinal Regression
Hongxu Ma, Han Zhou, Kai Tian, Xuefeng Zhang, Chunjie Chen, Han Li, Jihong Guan, Shuigeng Zhou
Abstract
Ordinal Regression (OR), which predicts the target values with inherent order, underpins a wide spectrum of applications within diverse domains. The intrinsic ordinal structure and non-stationary inter-class boundaries make OR fundamentally more challenging than conventional classification or regression. Existing approaches, predominantly based on Continuous Space Discretization (CSD), struggle to model these ordinal relationships, but are hampered by boundary ambiguity. Alternative rank-based methods, while effective, rely on implicit order dependencies and suffer from the rigidity of fixed binning. Inspired by the advances of generative language models, we propose Generative Ordinal Regression (GoR), a novel generative paradigm that reframes OR as a sequential generation task. GoR autoregressively predicts ordinal segments until a dynamic 〈EOS〉, explicitly capturing ordinal dependencies while enabling adaptive resolution and interpretable step-wise refinement. To support this process, we theoretically establish a bias-variance decomposed error bound and propose the Coverage-Distinctiveness Index (CoDi), a principled metric for vocabulary construction that balances quantization bias against statistical variance. The GoR framework is model-agnostic, ensuring broad compatibility with arbitrary task-specific architectures. Moreover, it can be seamlessly integrated with established optimization strategies for generative models at a negligible adaptation cost. Extensive experiments on 15 diverse ordinal regression benchmarks across five major domains demonstrate GoR's powerful generalization and consistent superiority over SOTA OR methods. The code is available at https://github.com/snailma0229/GoR.git .
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 0c238cd0-ef2f-4b58-9906-589ae4237753Cited by top-tier papers7
- RAM: Recover Any 3D Human Motion in-the-WildSen Jia, Ning Zhu, Jinqin Zhong, Jiale Zhou et al.CVPR 2026 · 12 citations
- Enhancing Molecular Property Predictions by Learning from Bond Modelling and InteractionsYunqing LIU, Yi Zhou, Wenqi FanICLR 2026 · 4 citations
- RL-ScanIQA: Reinforcement-Learned Scanpaths for Blind 360deg Image Quality AssessmentYujia Wang, Yuyan Li, Jiuming Liu, Fang-Lue Zhang et al.CVPR 2026 · 3 citations
- One Refiner to Unlock Them All: Inference-Time Reasoning Elicitation via Reinforcement Query RefinementYixiao Zhou, Dongzhou Cheng, Zhiliang Wu, Yi Yang et al.ACL 2026 · 3 citations
- DiffoR: A Unified Continuous Generative Framework for Universal Ordinal RegressionHongxu Ma, Lin Wang, Chenghou Jin, Han Zhou et al.KDD 2026 · 1 citation
Builds on39
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScaleAlexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn et al.ICLR 2021 · 21,477 citations
- Direct Preference Optimization: Your Language Model is Secretly a Reward ModelRafael Rafailov, Archit Sharma, Eric Mitchell, Christopher D. Manning et al.NeurIPS 2023 · 10,924 citations
- MUSIQ: Multi-scale Image Quality TransformerJunjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar et al.ICCV 2021 · 1,325 citations
- Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale PredictionKeyu Tian, Yi Jiang, Zehuan Yuan, Bingyue Peng et al.NeurIPS 2024 · 1,199 citations
- General Facial Representation Learning in a Visual-Linguistic MannerYinglin Zheng, Hao Yang, Ting Zhang, Jianmin Bao et al.CVPR 2022 · 161 citations
Related papers
- Ord2Seq: Regarding Ordinal Regression as Label Sequence PredictionJinhong Wang, Yi Cheng, Jintai Chen, Tingting Chen et al.ICCV 2023 · 18 citations
- OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal RegressionWanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang et al.NeurIPS 2022 · 65 citations
- Contrastive Order Learning: A General Framework for Ordinal RegressionChaewon Lee, BeomJun Shim, Kwang Choi, Chang-Su KimICML 2026
- Beyond Token-level Supervision: Unlocking the Potential of Decoding-based Regression via Reinforcement LearningMing Chen, Sheng Tang, Rong-Xi Tan, Ziniu Li et al.ICML 2026 · 2 citations
- Generative Regression Based Watch Time Prediction for Short-Video RecommendationHongxu Ma, Kai Tian, Tao Zhang, Xuefeng Zhang et al.WWW 2026 · 6 citations
