Lune

ACL Findings2021

Uncertainty Aware Review Hallucination for Science Article Classification

Korbinian Friedl, Georgios Rizos, Lukas Stappen, Madina Hasan, Lucia Specia, Thomas Hain, Björn W. Schuller

Abstract

The high subjectivity and costs inherent in peer reviewing have recently motivated the preliminary design of machine learning-based acceptance decision methods. However, such approaches are limited in that they: a) do not explore the usage of both the reviewer and area chair recommendations, b) do not explicitly model subjectivity on a per submission basis, and c) are not applicable in realistic settings, by assuming that review texts are available at test time, when these are exactly the inputs that should be considered to be missing in this application. We propose to utilise methods that model the aleatory uncertainty of the submissions, while also exploring different loss importance interpolations between area chair and reviewers' recommendations. We also propose a modality hallucination approach to impute review representations at test time, providing the first realistic evaluation framework for this challenging task.

Ask Lune

Know this paper in minutes, not an afternoon.

Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.

Questions to start from

Lune can draw on

the full paper · related work

Get the answer

Free to start. No credit card required.

Lineage

Builds onCited byLeft to right by year; the more cited, the higher.

Builds on1

  1. Momentum Contrast for Unsupervised Visual Representation LearningKaiming He, Haoqi Fan, Yuxin Wu, Saining Xie et al.CVPR 2020

Related papers

  1. The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance RatesGiuseppe Russo, Manoel Horta Ribeiro, Tim R. Davidson, Veniamin Veselovsky et al.CSCW 2025 · 10 citations
  2. What Can We Do to Improve Peer Review in NLP?Anna Rogers, Isabelle AugensteinEMNLP Findings 2020 · 32 citations
  3. Adaptive Contrastive Learning on Multimodal Transformer for Review Helpfulness PredictionThong Nguyen, Xiaobao Wu, Anh Tuan Luu, Zhen Hai et al.EMNLP 2022 · 8 citations
  4. Efficient, Uncertainty-based Moderation of Neural Networks Text ClassifiersJakob Smedegaard Andersen, Walid MaalejACL Findings 2022 · 9 citations
  5. Peer Grading the Peer Reviews: A Dual-Role Approach for Lightening the Scholarly Paper Review ProcessInes Arous, Jie Yang, Mourad Khayati, Philippe Cudré-MaurouxWWW 2021 · 14 citations
Dusk over the sea between two cliffs drawn in fine vertical lines