ACL Findings2026
The Double Bind: Revisiting Preprinting and Peer Review Two Years After the Removal of the ACL Anonymity Period
A Pranav, Shane Storks, Anne Lauscher
Abstract
ACL removed the anonymity period for conference submissions in February 2024, allowing unrestricted preprinting during review. To examine how preprints and author recognition affect outcomes across institutional hierarchies, we track preprinting trends for 47k publications, survey 75 NLP researchers, interview 14 community members, and analyze 1.9k peer reviews. We observe that more elite institutions post preprints more frequently (52% vs. 36% by 2025). Most participants agree that preprinting gives these institutions an advantage in peer review, and indeed, reviewer knowledge of authors inflates scores at elite institutions (d = 0.43, p < 0.001) but not elsewhere, also lowering review quality. Nonetheless, the anonymity period was found largely ineffective; instead, underrepresented researchers emphasize struggles with visibility, review quality, and external structural barriers. To counteract these inequities, we make recommendations for review quality improvement and increasing investment in diversity initiatives that center the perspectives of affected communities.
Ask Lune
Know this paper in minutes, not an afternoon.
Lune can read every page of it and the top-tier papers that cite it, and gives you its claims, its evidence and its limits, each one cited to the paper it comes from. No skimming, no AI slop.
Lineage
- NLPeer: A Unified Resource for the Computational Study of Peer Review cites Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and Beyond
- The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors cites A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large Conferences
- The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for Authors cites NLPeer: A Unified Resource for the Computational Study of Peer Review
Builds on4
- A Novice-Reviewer Experiment to Address Scarcity of Qualified Reviewers in Large ConferencesIvan Stelmakh, Nihar B. Shah, Aarti Singh, Hal Daumé IIIAAAI 2021 · 37 citations
- NLPeer: A Unified Resource for the Computational Study of Peer ReviewNils Dycke, Ilia Kuznetsov, Iryna GurevychACL 2023 · 17 citations
- Yes-Yes-Yes: Proactive Data Collection for ACL Rolling Review and BeyondNils Dycke, Ilia Kuznetsov, Iryna GurevychEMNLP Findings 2022 · 10 citations
- The Good, the Bad and the Constructive: Automatically Measuring Peer Review's Utility for AuthorsAbdelrahman Sadallah, Tim Baumgärtner, Iryna Gurevych, Ted BriscoeEMNLP 2025
Related papers
- Justice in Judgment: Unveiling (Hidden) Bias in LLM-assisted Peer ReviewsSai Suresh Macharla Vasu, Ivaxi Sheth, Hui-Po Wang, Ruta Binkyte et al.ACL Findings 2026 · 6 citations
- The AI Review Lottery: Widespread AI-Assisted Peer Reviews Boost Paper Scores and Acceptance RatesGiuseppe Russo, Manoel Horta Ribeiro, Tim R. Davidson, Veniamin Veselovsky et al.CSCW 2025 · 10 citations
- HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL ConferencesYusuke Sakai, Hidetaka Kamigaito, Taro WatanabeACL 2026 · 18 citations
- Using NLP to quantify the environmental cost and diversity benefits of in-person NLP conferencesPiotr Przybyla, Matthew ShardlowACL Findings 2022 · 5 citations
- Geographic Citation Gaps in NLP ResearchMukund Rungta, Janvijay Singh, Saif M. Mohammad, Diyi YangEMNLP 2022 · 10 citations
