A one-size-fits-all approach to improving randomness in paper assignment
The assignment of papers to reviewers is a crucial part of the peer review processes of large
publication venues, where organizers (eg, conference program chairs) rely on algorithms to …
publication venues, where organizers (eg, conference program chairs) rely on algorithms to …
Off-policy evaluation beyond overlap: partial identification through smoothness
Off-policy evaluation (OPE) is the problem of estimating the value of a target policy using
historical data collected under a different logging policy. OPE methods typically assume …
historical data collected under a different logging policy. OPE methods typically assume …
What Can Natural Language Processing Do for Peer Review?
The number of scientific articles produced every year is growing rapidly. Providing quality
control over them is crucial for scientists and, ultimately, for the public good. In modern …
control over them is crucial for scientists and, ultimately, for the public good. In modern …
Into the unknown: Assigning reviewers to papers with uncertain affinities
A successful peer review process requires that qualified and interested reviewers are
assigned to each paper. Most automated reviewer assignment approaches estimate a real …
assigned to each paper. Most automated reviewer assignment approaches estimate a real …
AgentReview: Exploring Peer Review Dynamics with LLM Agents
Peer review is fundamental to the integrity and advancement of scientific publication.
Traditional methods of peer review analyses often rely on exploration and statistics of …
Traditional methods of peer review analyses often rely on exploration and statistics of …
Causal Effect of Group Diversity on Redundancy and Coverage in Peer-Reviewing
A large host of scientific journals and conferences solicit peer reviews from multiple
reviewers for the same submission, aiming to gather a broader range of perspectives and …
reviewers for the same submission, aiming to gather a broader range of perspectives and …
Matchings, Predictions and Counterfactual Harm in Refugee Resettlement Processes
Resettlement agencies have started to adopt data-driven algorithmic matching to match
refugees to locations using employment rate as a measure of utility. Given a pool of …
refugees to locations using employment rate as a measure of utility. Given a pool of …
RelevAI-Reviewer: A Benchmark on AI Reviewers for Survey Paper Relevance
PH Couto, QP Ho, N Kumari, BK Rachmat… - arxiv preprint arxiv …, 2024 - arxiv.org
Recent advancements in Artificial Intelligence (AI), particularly the widespread adoption of
Large Language Models (LLMs), have significantly enhanced text analysis capabilities. This …
Large Language Models (LLMs), have significantly enhanced text analysis capabilities. This …
Reviewer No. 2: Old and New Problems in Peer Review (Dagstuhl Seminar 24052)
This report documents the program and the outcomes of Dagstuhl Seminar 24052"
Reviewer No. 2: Old and New Problems in Peer Review". This seminar provided a point of …
Reviewer No. 2: Old and New Problems in Peer Review". This seminar provided a point of …
[PDF][PDF] Making Peer Review Robust to Undesirable Behavior
S Jecmen - 2024 - reports-archive.adm.cs.cmu.edu
Scientific peer review is a critical part of the academic publication process, used across
disciplines and venues in various forms. Peer review generally relies on the good-faith …
disciplines and venues in various forms. Peer review generally relies on the good-faith …