Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …

Prior work has identified a resilient phenomenon that threatens the performance of human-
AI decision-making teams: overreliance, when people agree with an AI, even when it is …

Research exploring how to support decision-making has often used machine learning to
automate or assist human decisions. We take an alternative approach for improving decision …

Online chat functions as a discussion channel for diverse social issues. However,
deliberative discussion and consensus-reaching can be difficult in online chats in part …

In AI-assisted decision-making, humans often passively review AI's suggestion and decide
whether to accept or reject it as a whole. In such a paradigm, humans are found to rarely …

LLM chains enable complex tasks by decomposing work into a sequence of subtasks.
Similarly, the more established techniques of crowdsourcing workflows decompose complex …

When crowdsourcing the creation of machine learning datasets, statistical distributions that
capture diverse answers can represent ambiguous data better than a single best answer …

Properly aligning advanced AI systems with human values will require resolving many
uncertainties related to the psychology of human rationality, emotion, and biases. These can …

When groups of people are tasked with making a judgment, the issue of uncertainty often
arises. Existing methods to reduce uncertainty typically focus on iteratively improving …

Artificial intelligence (AI) assistants for clinical decision making show increasing promise in
medicine. However, medical assessments can be contentious, leading to expert …