Lune

EMNLP Findings2022

Exploiting Labeled and Unlabeled Data via Transformer Fine-tuning for Peer-Review Score Prediction

Panitan Muangkammuen, Fumiyo Fukumoto, Jiyi Li, Yoshimi Suzuki

Abstract

Automatic peer-review aspect score prediction (PASP) of academic papers can be a helpful assistant tool for both reviewers and authors. Most existing works on PASP utilize supervised learning techniques. However, the limited number of peer-review data deteriorates the performance of PASP. This paper presents a novel semi-supervised learning (SSL) method that incorporates the Transformer fine-tuning into the Γ-model, a variant of the Ladder network, to leverage contextual features from unlabeled data. Backpropagation simultaneously minimizes the sum of supervised and unsupervised cost functions, it can be easily trained in an end-to-end fashion. The proposed method is evaluated on the PeerRead benchmark. The experimental results demonstrate that our model outperforms the supervised and naive semi-supervised learning baselines. Our source codes are available online 1 .

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

1 top-tier paper has cited it since. Know what they found before your reviewers do.

Questions to start from

Lune can draw on

the full paper · the top-tier papers that cite it · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Cited by top-tier papers1

  1. Can AI Be a Good Peer Reviewer? A Survey of Peer Review Process, Evaluation, and the FutureSihong Wu, Owen Jiang, Yilun Zhao, Tiansheng Hu et al.ACL 2026 · 2 citations

Builds on3

  1. SeqVAT: Virtual Adversarial Training for Semi-Supervised Sequence LabelingLuoxin Chen, Weitong Ruan, Xinyue Liu, Jianhua LuACL 2020 · 118 citations
  2. Semi-Supervised Learning on Meta Structure: Multi-Task Tagging and Parsing in Low-Resource ScenariosKyungtae Lim, Jay Yoon Lee, Jaime G. Carbonell, Thierry PoibeauAAAI 2020 · 29 citations
  3. Semi-Supervised Text Classification with Balanced Deep Representation DistributionsChangchun Li, Ximing Li, Jihong OuyangACL 2021

Related papers

  1. Identifying Aspects in Peer ReviewsSheng Lu, Ilia Kuznetsov, Iryna GurevychEMNLP Findings 2025 · 1 citation
  2. Aggregating Multiple Heuristic Signals as Supervision for Unsupervised Automated Essay ScoringCong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng et al.ACL 2023 · 4 citations
  3. Unsupervised Readability Assessment via Learning from Weak Readability SignalsYuliang Liu, Zhiwei Jiang, Yafeng Yin, Cong Wang et al.SIGIR 2023 · 3 citations
  4. Unified Feature and Instance Based Domain Adaptation for Aspect-Based Sentiment AnalysisChenggong Gong, Jianfei Yu, Rui XiaEMNLP 2020 · 66 citations
  5. Training Vision Transformers for Semi-Supervised Semantic SegmentationXinting Hu, Li Jiang, Bernt SchieleCVPR 2024
Dusk over the sea between two cliffs drawn in fine vertical lines