A One-Size-Fits-All Approach to Improving Randomness in Paper Assignment
Yixuan Even Xu, Steven Jecmen, Zimeng Song, Fei Fang
摘要
The assignment of papers to reviewers is a crucial part of the peer review processes of large publication venues, where organizers (e.g., conference program chairs) rely on algorithms to perform automated paper assignment. As such, a major challenge for the organizers of these processes is to specify paper assignment algorithms that find appropriate assignments with respect to various desiderata. Although the main objective when choosing a good paper assignment is to maximize the expertise of each reviewer for their assigned papers, several other considerations make introducing randomization into the paper assignment desirable: robustness to malicious behavior, the ability to evaluate alternative paper assignments, reviewer diversity, and reviewer anonymity. However, it is unclear in what way one should randomize the paper assignment in order to best satisfy all of these considerations simultaneously. In this work, we present a practical, one-size-fits-all method for randomized paper assignment intended to perform well across different motivations for randomness. We show theoretically and experimentally that our method outperforms currently-deployed methods for randomized paper assignment on several intuitive randomness metrics, demonstrating that the randomized assignments produced by our method are general-purpose.
问问这篇 Paper
智能体会读完全文。
Lune 把这篇 Paper 索引到了每一个公式,引用它的顶会 Paper 也一样。你提问,回答直接引用原文。
引用它的顶会 Paper2
- AgentReview: Exploring Peer Review Dynamics with LLM AgentsYiqiao Jin, Qinlin Zhao, Yiyang Wang, Hao Chen 等EMNLP 2024 · 被引用 24 次
- Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to CollusionsJhih-Yi Hsieh, Aditi Raghunathan, Nihar B. ShahUSENIX Security 2025
它引用的顶会 Paper4
- Mitigating Manipulation in Peer Review via Randomized Reviewer AssignmentsSteven Jecmen, Hanrui Zhang, Ryan Liu, Nihar B. Shah 等NeurIPS 2020 · 被引用 90 次
- Making Paper Reviewing Robust to Bid Manipulation AttacksRuihan Wu, Chuan Guo, Felix Wu, Rahul Kidambi 等ICML 2021 · 被引用 27 次
- A Dataset on Malicious Paper Bidding in Peer ReviewSteven Jecmen, Minji Yoon, Vincent Conitzer, Nihar B. Shah 等WWW 2023 · 被引用 22 次
- Combating Collusion Rings Is Hard but PossibleNiclas Boehmer, Robert Bredereck, André NichterleinAAAI 2022 · 被引用 14 次
相关 Paper
- Counterfactual Evaluation of Peer-Review Assignment PoliciesMartin Saveski, Steven Jecmen, Nihar B. Shah, Johan UganderNeurIPS 2023 · 被引用 19 次
- No more Reviewer #2: Subverting Automatic Paper-Reviewer Assignment using Adversarial LearningThorsten Eisenhofer, Erwin Quiring, Jonas Möller, Doreen Riepel 等USENIX Security 2023
- "Flawed, but like democracy we don't have a better system": The Experts' Insights on the Peer Review Process of Evaluating Security PapersAnanta Soneji, Faris Bugra Kokulu, Carlos E. Rubio-Medrano, Tiffany Bao 等S&P 2022 · 被引用 17 次
- A Market-Inspired Bidding Scheme for Peer Review Paper AssignmentReshef Meir, Jérôme Lang, Julien Lesca, Nicholas Mattei 等AAAI 2021 · 被引用 33 次
- A Principled Approach to Randomized Selection under Uncertainty: Applications to Peer Review and Grant FundingAlexander Goldberg, Giulia Fanti, Nihar B. ShahNeurIPS 2025 · 被引用 3 次
