Are manipulation checks necessary?

DJ Hauser, PC Ellsworth, R Gonzalez - Frontiers in psychology, 2018 - frontiersin.org
Researchers are concerned about whether manipulations have the intended effects. Many
journals and reviewers view manipulation checks favorably, and they are widely reported in …

Validity and Mechanical Turk: An assessment of exclusion methods and interactive experiments

KA Thomas, S Clifford - Computers in Human Behavior, 2017 - Elsevier
Social science researchers increasingly recruit participants through Amazon's Mechanical
Turk (MTurk) platform. Yet, the physical isolation of MTurk participants, and perceived lack of …

Why the COVID-19 pandemic is a traumatic stressor

VME Bridgland, EK Moeck, DM Green, TL Swain… - PloS one, 2021 - journals.plos.org
The COVID-19 pandemic does not fit into prevailing Post-traumatic Stress Disorder (PTSD)
models, or diagnostic criteria, yet emerging research shows traumatic stress symptoms as a …

An MTurk crisis? Shifts in data quality and the impact on study results

M Chmielewski, SC Kucker - Social Psychological and …, 2020 - journals.sagepub.com
Amazon's Mechanical Turk (MTurk) is arguably one of the most important research tools of
the past decade. The ability to rapidly collect large amounts of high-quality human subjects …

An evaluation of Amazon's Mechanical Turk, its rapid rise, and its effective use

MD Buhrmester, S Talaifar… - Perspectives on …, 2018 - journals.sagepub.com
Over the past 2 decades, many social scientists have expanded their data-collection
capabilities by using various online research tools. In the 2011 article “Amazon's Mechanical …

Replication: How well do my results generalize now? The external validity of online privacy and security surveys

J Tang, E Birrell, A Lerner - … symposium on usable privacy and security …, 2022 - usenix.org
Privacy and security researchers often rely on data collected through online crowdsourcing
platforms such as Amazon Mechanical Turk (MTurk) and Prolific. Prior work---which used …

Common concerns with MTurk as a participant pool: Evidence and solutions

D Hauser, G Paolacci, J Chandler - Handbook of research …, 2019 - taylorfrancis.com
This chapter discusses common concerns that researchers have with Mechanical Turk
(MTurk), reviewing the evidence that bears upon each concern. It suggests that readers are …

Crowdsourcing consumer research

JK Goodman, G Paolacci - Journal of Consumer Research, 2017 - academic.oup.com
Data collection in consumer research has progressively moved away from traditional
samples (eg, university undergraduates) and toward Internet samples. In the last complete …

Attention by design: Using attention checks to detect inattentive respondents and improve data quality

JD Abbey, MG Meloy - Journal of Operations Management, 2017 - Elsevier
This paper examines attention checks and manipulation validations to detect inattentive
respondents in primary empirical data collection. These prima facie attention checks range …

Are attention check questions a threat to scale validity?

FYH Kung, N Kwok, DJ Brown - Applied Psychology, 2018 - Wiley Online Library
Attention checks have become increasingly popular in survey research as a means to filter
out careless respondents. Despite their widespread use, little research has empirically …