ACL Findings2021
Uncertainty Aware Review Hallucination for Science Article Classification
Korbinian Friedl, Georgios Rizos, Lukas Stappen, Madina Hasan, Lucia Specia, Thomas Hain, Björn W. Schuller
Abstract
The high subjectivity and costs inherent in peer reviewing have recently motivated the preliminary design of machine learning-based acceptance decision methods. However, such approaches are limited in that they: a) do not explore the usage of both the reviewer and area chair recommendations, b) do not explicitly model subjectivity on a per submission basis, and c) are not applicable in realistic settings, by assuming that review texts are available at test time, when these are exactly the inputs that should be considered to be missing in this application. We propose to utilise methods that model the aleatory uncertainty of the submissions, while also exploring different loss importance interpolations between area chair and reviewers' recommendations. We also propose a modality hallucination approach to impute review representations at test time, providing the first realistic evaluation framework for this challenging task.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
Builds on1
Related papers
- The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance RatesGiuseppe Russo, Manoel Horta Ribeiro, Tim R. Davidson, Veniamin Veselovsky et al.CSCW 2025 · 10 citations
- What Can We Do to Improve Peer Review in NLP?Anna Rogers, Isabelle AugensteinEMNLP Findings 2020 · 32 citations
- Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness PredictionThong Nguyen, Xiaobao Wu, Anh Tuan Luu, Zhen Hai et al.EMNLP 2022 · 8 citations
- Efficient, Uncertainty-based Moderation of Neural Networks Text ClassifiersJakob Smedegaard Andersen, Walid MaalejACL Findings 2022 · 9 citations
- Peer Grading the Peer Reviews: A Dual-Role Approach for Lightening the Scholarly Paper Review ProcessInes Arous, Jie Yang, Mourad Khayati, Philippe Cudré-MaurouxWWW 2021 · 14 citations
