Challenges, experiments, and computational solutions in peer review

NB Shah - Communications of the ACM, 2022 - dl.acm.org
Challenges, experiments, and computational solutions in peer review Page 1 76
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …

Counterfactual evaluation of peer-review assignment policies

M Saveski, S Jecmen, N Shah… - Advances in Neural …, 2023 - proceedings.neurips.cc
Peer review assignment algorithms aim to match research papers to suitable expert
reviewers, working to maximize the quality of the resulting reviews. A key challenge in …

A one-size-fits-all approach to improving randomness in paper assignment

Y Xu, S Jecmen, Z Song, F Fang - Advances in Neural …, 2023 - proceedings.neurips.cc
The assignment of papers to reviewers is a crucial part of the peer review processes of large
publication venues, where organizers (eg, conference program chairs) rely on algorithms to …

Dissecting submission limit in desk-rejections: A mathematical analysis of fairness in ai conference policies

Y Cao, X Li, Y Liang, Z Sha, Z Shi, Z Song… - arxiv preprint arxiv …, 2025 - arxiv.org
As AI research surges in both impact and volume, conferences have imposed submission
limits to maintain paper quality and alleviate organizational pressure. In this work, we …

I will have order! optimizing orders for fair reviewer assignment

J Payan, Y Zick - arxiv preprint arxiv:2108.02126, 2021 - arxiv.org
We present fast, fair, flexible, and welfare efficient algorithms for assigning reviewers to
submitted conference papers. Our approaches extend picking sequence mechanisms …

A dataset on malicious paper bidding in peer review

S Jecmen, M Yoon, V Conitzer, NB Shah… - Proceedings of the ACM …, 2023 - dl.acm.org
In conference peer review, reviewers are often asked to provide “bids” on each submitted
paper that express their interest in reviewing that paper. A paper assignment algorithm then …

No more reviewer# 2: Subverting automatic {Paper-Reviewer} assignment using adversarial learning

T Eisenhofer, E Quiring, J Möller, D Riepel… - 32nd USENIX Security …, 2023 - usenix.org
The number of papers submitted to academic conferences is steadily rising in many
scientific disciplines. To handle this growth, systems for automatic paper-reviewer …

FairColor: An efficient algorithm for the balanced and fair reviewer assignment problem

K Bouanane, AN Medakene, A Benbelghit… - Information Processing …, 2024 - Elsevier
As the volume of submitted papers continues to rise, ensuring a fair and accurate
assignment of manuscripts to reviewers has become increasingly critical for academic …

Tradeoffs in preventing manipulation in paper bidding for reviewer assignment

S Jecmen, NB Shah, F Fang, V Conitzer - arxiv preprint arxiv:2207.11315, 2022 - arxiv.org
Many conferences rely on paper bidding as a key component of their reviewer assignment
procedure. These bids are then taken into account when assigning reviewers to help ensure …

Fair and Welfare-Efficient Constrained Multi-matchings under Uncertainty

E Lobo, J Payan, C Cousins… - Advances in Neural …, 2025 - proceedings.neurips.cc
We study fair allocation of constrained resources, where a market designer optimizes overall
welfare while maintaining group fairness. In many large-scale settings, utilities are not …