Testing Under Strategic Manipulation: Mechanism Design for Human and AI Institutions
Xiaoyun Qiu, Liren Shan
Abstract
We study how the design of testing institutions, encompassing both the tests themselves and the procedures used to administer them, shapes selection outcomes in environments with multiple criteria and strategic agents. We model the testing agency as either a set of independent bureaucracies (each test administered separately) or a joint bureaucracy (where test order and personalization can be coordinated). Our mechanism design analysis shows that under a joint bureaucracy, fixed-order sequential mechanisms with stringent tests are optimal for maximizing the probability mass of qualified candidates selected. Furthermore, we demonstrate that personalizing tests through upfront communication, now increasingly feasible via AI and automation, can select all qualified candidates. Finally, we compare institutional settings and quantify the value of controlling test order, showing that the benefit depends critically on the distribution of testees and the stringency of optimal tests. Our results contribute to the design of robust, efficient, and fair testing systems in both human and AI-mediated environments.
Ask about this paper
Your agent reads all of it.
Lune indexed this paper to the last equation, along with the top-tier papers that cite it. Ask a question and the answer quotes them.
Your agent calls
Luneget_paper_fulltext
Free to start. No credit card required.
Terminal
Install the CLIlune papers fulltext 9fdd1ec8-445f-44cc-8065-2e02f8ef37dfBuilds on2
Related papers
- Centralized Selection with Preferences in the Presence of BiasesL. Elisa Celis, Amit Kumar, Nisheeth K. Vishnoi, Andrew XuICML 2024 · 1 citation
- Matchings Under Biased and Correlated EvaluationsAmit Kumar, Nisheeth K. VishnoiNeurIPS 2025
- Multi-Level Strategic Classification: Incentivizing Improvement through Promotion and Relegation DynamicsZiyuan Huang, Lina Alkarmi, Mingyan LiuICML 2026 · 1 citation
- Strategic Costs of Perceived Bias in Fair SelectionL. Elisa Celis, Lingxiao Huang, Milind A. Sohoni, Nisheeth K. VishnoiNeurIPS 2025
- Impartial Selection with PredictionsJavier Cembrano, Felix Fischer, Max KlimmNeurIPS 2025
