A checklist to combat cognitive biases in crowdsourcing
Recent research has demonstrated that cognitive biases such as the confirmation bias or the
anchoring effect can negatively affect the quality of crowdsourced data. In practice, however …
anchoring effect can negatively affect the quality of crowdsourced data. In practice, however …
Moral machine or tyranny of the majority?
With artificial intelligence systems increasingly applied in consequential domains,
researchers have begun to ask how AI systems ought to act in ethically charged situations …
researchers have begun to ask how AI systems ought to act in ethically charged situations …
A new binary programming formulation and social choice property for Kemeny rank aggregation
Rank aggregation is widely used in group decision making and many other applications,
where it is of interest to consolidate heterogeneous ordered lists. Oftentimes, these rankings …
where it is of interest to consolidate heterogeneous ordered lists. Oftentimes, these rankings …
An axiomatic distance methodology for aggregating multimodal evaluations
This work introduces a multimodal data aggregation methodology featuring optimization
models and algorithms for jointly aggregating heterogeneous ordinal and cardinal …
models and algorithms for jointly aggregating heterogeneous ordinal and cardinal …
Improving crowdsourcing-based image classification through expanded input elicitation and machine learning
This work investigates how different forms of input elicitation obtained from crowdsourcing
can be utilized to improve the quality of inferred labels for image classification tasks, where …
can be utilized to improve the quality of inferred labels for image classification tasks, where …
Relaxed forced choice improves performance of visual quality assessment methods
In image quality assessment, a collective visual quality score for an image or video is
obtained from the individual ratings of many subjects. One commonly used format for these …
obtained from the individual ratings of many subjects. One commonly used format for these …
Elicitation and aggregation of multimodal estimates improve wisdom of crowd effects on ordering tasks
We present a wisdom of crowds study where participants are asked to order a small set of
images based on the number of dots they contain and then to guess the respective number …
images based on the number of dots they contain and then to guess the respective number …
Enhancing image classification capabilities of crowdsourcing-based methods through expanded input elicitation
This study investigates how different forms of input elicitation obtained from crowdsourcing
can be utilized to improve the quality of inferred labels for image classification tasks, where …
can be utilized to improve the quality of inferred labels for image classification tasks, where …
Assessing the effects of expanded input elicitation and machine learning-based priming on crowd stock prediction
H Bhogaraju, A Jain, J Jaiswal… - International Conference …, 2023 - Springer
The stock market is affected by a seemingly infinite number of factors, making it highly
uncertain yet impactful. A large determinant of stock performance is public sentiment, which …
uncertain yet impactful. A large determinant of stock performance is public sentiment, which …
Combining Human and AI Strengths in Object Counting under Information Asymmetry
S Liu, M Steyvers - Proceedings of the AAAI Conference on Human …, 2024 - ojs.aaai.org
With the recent development of artificial intelligence (AI), hybrid human-AI teams have
gained more attention and have been employed to solve all kinds of problems. However …
gained more attention and have been employed to solve all kinds of problems. However …