Eccv caption: Correcting false negatives by collecting machine-and-human-verified image-caption associations for ms-coco

S Chun, W Kim, S Park, M Chang, SJ Oh - European Conference on …, 2022‏ - Springer
Image-Text matching (ITM) is a common task for evaluating the quality of Vision and
Language (VL) models. However, existing ITM benchmarks have a significant limitation …

The perpetual work life of crowdworkers: How tooling practices increase fragmentation in crowdwork

AC Williams, G Mark, K Milland, E Lank… - Proceedings of the ACM …, 2019‏ - dl.acm.org
Crowdworkers regularly support their work with scripts, extensions, and software to enhance
their productivity. Despite their evident significance, little is understood regarding how these …

Efficient elicitation approaches to estimate collective crowd answers

JJY Chung, JY Song, S Kutty, S Hong, J Kim… - Proceedings of the …, 2019‏ - dl.acm.org
When crowdsourcing the creation of machine learning datasets, statistical distributions that
capture diverse answers can represent ambiguous data better than a single best answer …

Find the Bot!: Gamifying Facial Emotion Recognition for Both Human Training and Machine Learning Data Collection

Y Yang, A Shin, N Kim, H Woo, JJY Chung… - Proceedings of the 2024 …, 2024‏ - dl.acm.org
Facial emotion recognition (FER) constitutes an essential social skill for both humans and
machines to interact with others. To this end, computer interfaces serve as valuable tools for …

Forecast aggregation via peer prediction

J Wang, Y Liu, Y Chen - Proceedings of the AAAI conference on human …, 2021‏ - ojs.aaai.org
Crowdsourcing enables the solicitation of forecasts on a variety of prediction tasks from
distributed groups of people. How to aggregate the solicited forecasts, which may vary in …

Popup: reconstructing 3D video using particle filtering to aggregate crowd responses

JY Song, SJ Lemmer, MX Liu, S Yan, J Kim… - Proceedings of the 24th …, 2019‏ - dl.acm.org
Collecting a sufficient amount of 3D training data for autonomous vehicles to handle rare,
but critical, traffic events (eg, collisions) may take decades of deployment. Abundant video …

Eureca: Enhanced understanding of real environments via crowd assistance

S Gouravajhala, J Yim, K Desingh, Y Huang… - Proceedings of the …, 2018‏ - ojs.aaai.org
Indoor robots hold the promise of automatically handling mundane daily tasks, hel** to
improve access for people with disabilities, and providing on-demand access to remote …

[PDF][PDF] On facilitating human-computer interaction via hybrid intelligence systems

WS Lasecki - Proceedings of the 7th annual ACM Conference on …, 2019‏ - wslasecki.com
What does the perfect interaction between a human and a computer look like? This question
has driven much work in Human-Computer Interaction (HCI) over the past several decades …

Crowdsourcing more effective initializations for single-target trackers through automatic re-querying

SJ Lemmer, JY Song, JJ Corso - … of the 2021 CHI Conference on Human …, 2021‏ - dl.acm.org
In single-target video object tracking, an initial bounding box is drawn around a target object
and propagated through a video. When this bounding box is provided by a careful human …

Explainable modeling of annotations in crowdsourcing

AT Nguyen, M Lease, BC Wallace - Proceedings of the 24th International …, 2019‏ - dl.acm.org
Aggregation models for improving the quality of annotations collected via crowdsourcing
have been widely studied, but far less has been done to explain why annotators make the …