Appropriate reliance on AI advice: Conceptualization and the effect of explanations

M Schemmer, N Kuehl, C Benz, A Bartos… - Proceedings of the 28th …, 2023 - dl.acm.org
AI advice is becoming increasingly popular, eg, in investment and medical treatment
decisions. As this advice is typically imperfect, decision-makers have to exert discretion as to …

Two-stage learning to defer with multiple experts

A Mao, C Mohri, M Mohri… - Advances in neural …, 2023 - proceedings.neurips.cc
We study a two-stage scenario for learning to defer with multiple experts, which is crucial in
practice for many applications. In this scenario, a predictor is derived in a first stage by …

Human-AI collaboration: the effect of AI delegation on human task performance and task satisfaction

P Hemmer, M Westphal, M Schemmer… - Proceedings of the 28th …, 2023 - dl.acm.org
Recent work has proposed artificial intelligence (AI) models that can learn to decide whether
to make a prediction for an instance of a task or to delegate it to a human by considering …

Realizable -Consistent and Bayes-Consistent Loss Functions for Learning to Defer

A Mao, M Mohri, Y Zhong - Advances in neural information …, 2025 - proceedings.neurips.cc
We present a comprehensive study of surrogate loss functions for learning to defer. We
introduce a broad family of surrogate losses, parameterized by a non-increasing function …

Learning to defer to a population: A meta-learning approach

D Tailor, A Patra, R Verma… - International …, 2024 - proceedings.mlr.press
The learning to defer (L2D) framework allows autonomous systems to be safe and robust by
allocating difficult decisions to a human expert. All existing work on L2D assumes that each …

Complementarity in human-AI collaboration: Concept, sources, and evidence

P Hemmer, M Schemmer, N Kühl, M Vössing… - arxiv preprint arxiv …, 2024 - arxiv.org
Artificial intelligence (AI) can improve human decision-making in various application areas.
Ideally, collaboration between humans and AI should lead to complementary team …

Principled approaches for learning to defer with multiple experts

A Mao, M Mohri, Y Zhong - International Workshop on Combinatorial …, 2024 - Springer
We present a study of surrogate losses and algorithms for the general problem of learning to
defer with multiple experts. We first introduce a new family of surrogate losses specifically …

Learning to defer to multiple experts: Consistent surrogate losses, confidence calibration, and conformal ensembles

R Verma, D Barrejón… - … Conference on Artificial …, 2023 - proceedings.mlr.press
We study the statistical properties of learning to defer (L2D) to multiple experts. In particular,
we address the open problems of deriving a consistent surrogate loss, confidence …

Regression with multi-expert deferral

A Mao, M Mohri, Y Zhong - arxiv preprint arxiv:2403.19494, 2024 - arxiv.org
Learning to defer with multiple experts is a framework where the learner can choose to defer
the prediction to several experts. While this problem has received significant attention in …

[HTML][HTML] Confirmation bias in AI-assisted decision-making: AI triage recommendations congruent with expert judgments increase psychologist trust and …

A Bashkirova, D Krpan - Computers in Human Behavior: Artificial Humans, 2024 - Elsevier
The surging global demand for mental healthcare (MH) services has amplified the interest in
utilizing AI-assisted technologies in critical MH components, including assessment and …