Quality control in crowdsourcing: A survey of quality attributes, assessment techniques, and assurance actions

F Daniel, P Kucherbaev, C Cappiello… - ACM Computing …, 2018 - dl.acm.org
Crowdsourcing enables one to leverage on the intelligence and wisdom of potentially large
groups of individuals toward solving problems. Common problems approached with …

A survey on task assignment in crowdsourcing

D Hettiachchi, V Kostakos, J Goncalves - ACM Computing Surveys …, 2022 - dl.acm.org
Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …

The future of crowd work

A Kittur, JV Nickerson, M Bernstein, E Gerber… - Proceedings of the …, 2013 - dl.acm.org
Paid crowd work offers remarkable opportunities for improving productivity, social mobility,
and the global economy by engaging a geographically distributed workforce to complete …

Quantifying the invisible labor in crowd work

C Toxtli, S Suri, S Savage - Proceedings of the ACM on human-computer …, 2021 - dl.acm.org
Crowdsourcing markets provide workers with a centralized place to find paid work. What
may not be obvious at first glance is that, in addition to the work they do for pay, crowd …

Unsupervised clickstream clustering for user behavior analysis

G Wang, X Zhang, S Tang, H Zheng… - Proceedings of the 2016 …, 2016 - dl.acm.org
Online services are increasingly dependent on user participation. Whether it's online social
networks or crowdsourcing services, understanding user behavior is important yet …

Street-level algorithms: A theory at the gaps between policy and decisions

A Alkhatib, M Bernstein - Proceedings of the 2019 CHI Conference on …, 2019 - dl.acm.org
Errors and biases are earning algorithms increasingly malignant reputations in society. A
central challenge is that algorithms must bridge the gap between high-level policy and on …

Citesee: Augmenting citations in scientific papers with persistent and personalized historical context

JC Chang, AX Zhang, J Bragg, A Head, K Lo… - Proceedings of the …, 2023 - dl.acm.org
When reading a scholarly article, inline citations help researchers contextualize the current
article and discover relevant prior work. However, it can be challenging to prioritize and …

Examining crowd work and gig work through the historical lens of piecework

A Alkhatib, MS Bernstein, M Levi - … of the 2017 CHI conference on human …, 2017 - dl.acm.org
The internet is empowering the rise of crowd work, gig work, and other forms of on-demand
labor. A large and growing body of scholarship has attempted to predict the socio-technical …

Fair work: Crowd work minimum wage with one line of code

ME Whiting, G Hugh, MS Bernstein - … of the AAAI Conference on Human …, 2019 - ojs.aaai.org
Accurate task pricing in microtask marketplaces requires substantial effort via trial and error,
contributing to a pattern of worker underpayment. In response, we introduce Fair Work …

Flock: Hybrid crowd-machine learning classifiers

J Cheng, MS Bernstein - Proceedings of the 18th ACM conference on …, 2015 - dl.acm.org
We present hybrid crowd-machine learning classifiers: classification models that start with a
written description of a learning goal, use the crowd to suggest predictive features and label …