Lune

EMNLP Findings2022

Enhancing Automatic Readability Assessment with Pre-training and Soft Labels for Ordinal Regression

Jinshan Zeng, Yudong Xie, Xianglong Yu, John Lee, Ding-Xuan Zhou

Abstract

The readability assessment task aims to assign a difficulty grade to a text. While neural models have recently demonstrated impressive performance, most do not exploit the ordinal nature of the difficulty grades, and make little effort for model initialization to facilitate fine-tuning. We address these limitations with soft labels for ordinal regression, and with model pre-training through prediction of pairwise relative text difficulty. We incorporate these two components into a model based on hierarchical attention networks, and evaluate its performance on both English and Chinese datasets. Experimental results show that our proposed model outperforms competitive neural models and statistical classifiers on most datasets.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

2 top-tier papers have cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

  • Self-Supervised Collaborative Information Bottleneck for Text Readability Assessment cites Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
  • Self-Supervised Collaborative Information Bottleneck for Text Readability Assessment cites InterpretARA: Enhancing Hybrid Automatic Readability Assessment with Linguistic Feature Interpreter and Contrastive Learning
  • A Neural Pairwise Ranking Model for Readability Assessment cites Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
  • InterpretARA: Enhancing Hybrid Automatic Readability Assessment with Linguistic Feature Interpreter and Contrastive Learning cites Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features
Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers2

  1. InterpretARA: Enhancing Hybrid Automatic Readability Assessment with Linguistic Feature Interpreter and Contrastive LearningJinshan Zeng, Xianchao Tong, Xianglong Yu, Wenyan Xiao et al.AAAI 2024 · 3 citations
  2. Self-Supervised Collaborative Information Bottleneck for Text Readability AssessmentJinshan Zeng, Xianglong Yu, Xianchao Tong, Wenyan XiaoAAAI 2025

Builds on4

  1. ALBERT: A Lite BERT for Self-supervised Learning of Language RepresentationsZhenzhong Lan, Mingda Chen, Sebastian Goodman, Kevin Gimpel et al.ICLR 2020 · 7,418 citations
  2. Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic FeaturesBruce W. Lee, Yoo Sung Jang, Jason Hyung-Jong LeeEMNLP 2021 · 46 citations
  3. Pre-training Is (Almost) All You Need: An Application to Commonsense ReasoningAlexandre Tamborrino, Nicola Pellicanò, Baptiste Pannier, Pascal Voitot et al.ACL 2020 · 30 citations
  4. A Neural Pairwise Ranking Model for Readability AssessmentJustin Lee, Sowmya VajjalaACL Findings 2022 · 26 citations

Related papers

  1. Unsupervised Readability Assessment via Learning from Weak Readability SignalsYuliang Liu, Zhiwei Jiang, Yafeng Yin, Cong Wang et al.SIGIR 2023 · 3 citations
  2. Hierarchy-aware Label Semantics Matching Network for Hierarchical Text ClassificationHaibin Chen, Qianli Ma, Zhenxi Lin, Jiangyue YanACL 2021
  3. Hierarchical Attention Network with Pairwise Loss for Chinese Zero Pronoun ResolutionPeiqin Lin, Meng YangAAAI 2020 · 9 citations
  4. Be More with Less: Hypergraph Attention Networks for Inductive Text ClassificationKaize Ding, Jianling Wang, Jundong Li, Dingcheng Li et al.EMNLP 2020 · 210 citations
  5. HYDRA: A Multi-Head Encoder-only Architecture for Hierarchical Text ClassificationFabian Karl, Ansgar ScherpEMNLP 2025
Dusk over the sea between two cliffs drawn in fine vertical lines