ACL Findings2024
Exploring Ordinality in Text Classification: A Comparative Study of Explicit and Implicit Techniques
Siva Rajesh Kasa, Aniket Goel, Karan Gupta, Sumegh Roychowdhury, Pattisapu Priyatam, Anish Bhanushali, Prasanna Srinivasa Murthy
Abstract
Ordinal Classification (OC) is a widely encountered challenge in Natural Language Processing (NLP), with applications in various domains such as sentiment analysis, rating prediction, and more. Previous approaches to tackle OC have primarily focused on modifying existing or creating novel loss functions that explicitly account for the ordinal nature of labels. However, with the advent of Pretrained Language Models (PLMs), it became possible to tackle ordinality through the implicit semantics of the labels as well. This paper provides a comprehensive theoretical and empirical examination of both these approaches. Furthermore, we also offer strategic recommendations regarding the most effective approach to adopt based on specific settings.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
2 top-tier papers have cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers2
- SLACE: A Monotone and Balance-Sensitive Loss Function for Ordinal RegressionInbar Nachmani, Bar Genossar, Coral Scharf, Roee Shraga et al.AAAI 2025 · 1 citation
- Generative or Discriminative? Revisiting Text Classification in the Era of TransformersSiva Rajesh Kasa, Karan Gupta, Sumegh Roychowdhury, Ashutosh Kumar et al.EMNLP 2025 · 1 citation
Builds on4
- Calibrate Before Use: Improving Few-shot Performance of Language ModelsZihao Zhao, Eric Wallace, Shi Feng, Dan Klein et al.ICML 2021 · 1,843 citations
- Non-asymptotic convergence bounds for Wasserstein approximation using point cloudsQuentin Mérigot, Filippo Santambrogio, Clément SarrazinNeurIPS 2021 · 40 citations
- On Robustness of Finetuned Transformer-based NLP ModelsPavan Kalyan Reddy Neerudu, Subba Reddy Oota, Mounika Marreddy, Venkateswara Rao Kagita et al.EMNLP Findings 2023 · 7 citations
- A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language ModelsWoojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen et al.ACL 2022
Related papers
- Evaluating Evaluation Measures for Ordinal Classification and Ordinal QuantificationTetsuya SakaiACL 2021
- Beyond Binary Preferences: A Principled Framework for Reward Modeling with Ordinal FeedbackAmirhossein Afsharrad, Ruida Zhou, Luca Viano, Sanjay Lall et al.ICLR 2026 · 4 citations
- An Effectiveness Metric for Ordinal Classification: Formal Properties and Experimental ResultsEnrique Amigó, Julio Gonzalo, Stefano Mizzaro, Jorge Carrillo-de-AlbornozACL 2020 · 39 citations
- OrdinalCLIP: Learning Rank Prompts for Language-Guided Ordinal RegressionWanhua Li, Xiaoke Huang, Zheng Zhu, Yansong Tang et al.NeurIPS 2022 · 65 citations
- HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text ClassificationZihan Wang, Peiyi Wang, Tianyu Liu, Binghuai Lin et al.EMNLP 2022 · 42 citations
