Challenges, experiments, and computational solutions in peer review Page 1 76
COMMUNICATIONS OF THE ACM | JUNE 2022 | VOL. 65 | NO. 6 review articles IMA GER YB Y …

Given the rapid ascent of large language models (LLMs), we study the question:(How) can
large language models help in reviewing of scientific papers or proposals? We first conduct …

The rapid development of science and technology has been accompanied by an
exponential growth in peer-reviewed scientific publications. At the same time, the review of …

We consider three important challenges in conference peer review:(i) reviewers maliciously
attempting to get assigned to certain papers to provide positive reviews, possibly as part of …

The number of scientific articles produced every year is growing rapidly. Providing quality
control over them is crucial for scientists and, ultimately, for the public good. In modern …

The growing number of preprints allows reviewers to identify the authors' identities prior to
the peer review process. Yet, it remains unclear whether the preprint exposure of prestigious …

Many peer-review processes involve reviewers submitting their independent reviews,
followed by a discussion between the reviewers of each paper. A common question among …

Strategic behavior is a fundamental problem in a variety of real-world applications that
require some form of peer assessment, such as peer grading of homeworks, grant proposal …

Modern machine learning and computer science conferences are experiencing a surge in
the number of submissions that challenges the quality of peer review as the number of …

The surge in the number of scientific submissions has brought challenges to the work of
peer review. In this paper, as a first step, we explore the possibility of designing an …