Towards a science of human-AI decision making: An overview of design space in empirical human-subject studies

V Lai, C Chen, A Smith-Renner, QV Liao… - Proceedings of the 2023 …, 2023 - dl.acm.org
AI systems are adopted in numerous domains due to their increasingly strong predictive
performance. However, in high-stakes domains such as criminal justice and healthcare, full …

Predictive validity of pretrial risk assessments: A systematic review of the literature

SL Desmarais, SA Zottola… - Criminal Justice …, 2021 - journals.sagepub.com
Bail reform is swee** the nation and many jurisdictions are looking to pretrial risk
assessment as one potential strategy to support these efforts. This article summarizes the …

Towards a science of human-ai decision making: a survey of empirical studies

V Lai, C Chen, QV Liao, A Smith-Renner… - arxiv preprint arxiv …, 2021 - arxiv.org
As AI systems demonstrate increasingly strong predictive performance, their adoption has
grown in numerous domains. However, in high-stakes domains such as criminal justice and …

Wilds: A benchmark of in-the-wild distribution shifts

PW Koh, S Sagawa, H Marklund… - International …, 2021 - proceedings.mlr.press
Distribution shifts—where the training distribution differs from the test distribution—can
substantially degrade the accuracy of machine learning (ML) systems deployed in the wild …

Human-ai collaboration via conditional delegation: A case study of content moderation

V Lai, S Carton, R Bhatnagar, QV Liao… - Proceedings of the …, 2022 - dl.acm.org
Despite impressive performance in many benchmark datasets, AI models can still make
mistakes, especially among out-of-distribution examples. It remains an open question how …

[KNJIGA][B] The psychology of criminal conduct

J Bonta, DA Andrews - 2023 - taylorfrancis.com
The Psychology of Criminal Conduct, Seventh Edition, provides a psychological and
evidence-informed perspective of criminal behavior that sets it apart from many …

Policy advice and best practices on bias and fairness in AI

JM Alvarez, AB Colmenarejo, A Elobaid… - Ethics and Information …, 2024 - Springer
The literature addressing bias and fairness in AI models (fair-AI) is growing at a fast pace,
making it difficult for novel researchers and practitioners to have a bird's-eye view picture of …

Understanding the effect of out-of-distribution examples and interactive explanations on human-ai decision making

H Liu, V Lai, C Tan - Proceedings of the ACM on Human-Computer …, 2021 - dl.acm.org
Although AI holds promise for improving human decision making in societally critical
domains, it remains an open question how human-AI teams can reliably outperform AI alone …

Fragile algorithms and fallible decision-makers: lessons from the justice system

J Ludwig, S Mullainathan - Journal of Economic Perspectives, 2021 - aeaweb.org
Algorithms (in some form) are already widely used in the criminal justice system. We draw
lessons from this experience for what is to come for the rest of society as machine learning …

Understanding uncertainty: how lay decision-makers perceive and interpret uncertainty in human-AI decision making

S Prabhudesai, L Yang, S Asthana, X Huan… - Proceedings of the 28th …, 2023 - dl.acm.org
Decision Support Systems (DSS) based on Machine Learning (ML) often aim to assist lay
decision-makers, who are not math-savvy, in making high-stakes decisions. However …