Quality control in crowdsourcing: A survey of quality attributes, assessment techniques, and assurance actions
Crowdsourcing enables one to leverage on the intelligence and wisdom of potentially large
groups of individuals toward solving problems. Common problems approached with …
groups of individuals toward solving problems. Common problems approached with …
A survey on task assignment in crowdsourcing
Quality improvement methods are essential to gathering high-quality crowdsourced data,
both for research and industry applications. A popular and broadly applicable method is task …
both for research and industry applications. A popular and broadly applicable method is task …
The future of crowd work
Paid crowd work offers remarkable opportunities for improving productivity, social mobility,
and the global economy by engaging a geographically distributed workforce to complete …
and the global economy by engaging a geographically distributed workforce to complete …
Quantifying the invisible labor in crowd work
Crowdsourcing markets provide workers with a centralized place to find paid work. What
may not be obvious at first glance is that, in addition to the work they do for pay, crowd …
may not be obvious at first glance is that, in addition to the work they do for pay, crowd …
Unsupervised clickstream clustering for user behavior analysis
Online services are increasingly dependent on user participation. Whether it's online social
networks or crowdsourcing services, understanding user behavior is important yet …
networks or crowdsourcing services, understanding user behavior is important yet …
Street-level algorithms: A theory at the gaps between policy and decisions
Errors and biases are earning algorithms increasingly malignant reputations in society. A
central challenge is that algorithms must bridge the gap between high-level policy and on …
central challenge is that algorithms must bridge the gap between high-level policy and on …
Citesee: Augmenting citations in scientific papers with persistent and personalized historical context
When reading a scholarly article, inline citations help researchers contextualize the current
article and discover relevant prior work. However, it can be challenging to prioritize and …
article and discover relevant prior work. However, it can be challenging to prioritize and …
Examining crowd work and gig work through the historical lens of piecework
The internet is empowering the rise of crowd work, gig work, and other forms of on-demand
labor. A large and growing body of scholarship has attempted to predict the socio-technical …
labor. A large and growing body of scholarship has attempted to predict the socio-technical …
Fair work: Crowd work minimum wage with one line of code
Accurate task pricing in microtask marketplaces requires substantial effort via trial and error,
contributing to a pattern of worker underpayment. In response, we introduce Fair Work …
contributing to a pattern of worker underpayment. In response, we introduce Fair Work …
Flock: Hybrid crowd-machine learning classifiers
We present hybrid crowd-machine learning classifiers: classification models that start with a
written description of a learning goal, use the crowd to suggest predictive features and label …
written description of a learning goal, use the crowd to suggest predictive features and label …