EMNLP Findings2022
Exploiting Labeled and Unlabeled Data via Transformer Fine-tuning for Peer-Review Score Prediction
Panitan Muangkammuen, Fumiyo Fukumoto, Jiyi Li, Yoshimi Suzuki
Abstract
Automatic peer-review aspect score prediction (PASP) of academic papers can be a helpful assistant tool for both reviewers and authors. Most existing works on PASP utilize supervised learning techniques. However, the limited number of peer-review data deteriorates the performance of PASP. This paper presents a novel semi-supervised learning (SSL) method that incorporates the Transformer fine-tuning into the Γ-model, a variant of the Ladder network, to leverage contextual features from unlabeled data. Backpropagation simultaneously minimizes the sum of supervised and unsupervised cost functions, it can be easily trained in an end-to-end fashion. The proposed method is evaluated on the PeerRead benchmark. The experimental results demonstrate that our model outperforms the supervised and naive semi-supervised learning baselines. Our source codes are available online 1 .
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
1 top-tier paper has cited it since. Know what they found before your reviewers do.
Lune can draw on
the full paper · the top-tier papers that cite it · related work
Free to start. No credit card required.
Lineage
Cited by top-tier papers1
Builds on3
- SeqVAT: Virtual Adversarial Training for Semi-Supervised Sequence LabelingLuoxin Chen, Weitong Ruan, Xinyue Liu, Jianhua LuACL 2020 · 118 citations
- Semi-Supervised Learning on Meta Structure: Multi-Task Tagging and Parsing in Low-Resource ScenariosKyungtae Lim, Jay Yoon Lee, Jaime G. Carbonell, Thierry PoibeauAAAI 2020 · 29 citations
- Semi-Supervised Text Classification with Balanced Deep Representation DistributionsChangchun Li, Ximing Li, Jihong OuyangACL 2021
Related papers
- Identifying Aspects in Peer ReviewsSheng Lu, Ilia Kuznetsov, Iryna GurevychEMNLP Findings 2025 · 1 citation
- Aggregating Multiple Heuristic Signals as Supervision for Unsupervised Automated Essay ScoringCong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng et al.ACL 2023 · 4 citations
- Unsupervised Readability Assessment via Learning from Weak Readability SignalsYuliang Liu, Zhiwei Jiang, Yafeng Yin, Cong Wang et al.SIGIR 2023 · 3 citations
- Unified Feature and Instance Based Domain Adaptation for Aspect-Based Sentiment AnalysisChenggong Gong, Jianfei Yu, Rui XiaEMNLP 2020 · 66 citations
- Training Vision Transformers for Semi-Supervised Semantic SegmentationXinting Hu, Li Jiang, Bernt SchieleCVPR 2024
