Are Large Language Models Consistent over Value-laden Questions?

J Moore, T Deshpande, D Yang - arxiv preprint arxiv:2407.02996, 2024 - arxiv.org
Large language models (LLMs) appear to bias their survey answers toward certain values.
Nonetheless, some argue that LLMs are too inconsistent to simulate particular values. Are …

[HTML][HTML] Normad: A benchmark for measuring the cultural adaptability of large language models

A Rao, A Yerukola, V Shah, K Reinecke… - arxiv preprint arxiv …, 2024 - maartensap.com
Maarten Sap - Publications Maarten Sap Publications Contact About Me CV Notes/Blogposts
Applying to grad school Giving feedback for talks Notes from my 2020 Academic Job Search …

Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experiment

K Vida, F Damken, A Lauscher - … of the AAAI/ACM Conference on AI …, 2024 - ojs.aaai.org
Large language models (LLMs) increasingly find their way into the most diverse areas of our
everyday lives. They indirectly influence people's decisions or opinions through their daily …

Decolonial AI Alignment: Openness, Viśesa-Dharma, and Including Excluded Knowledges

KR Varshney - Proceedings of the AAAI/ACM Conference on AI, Ethics …, 2024 - ojs.aaai.org
Prior work has explicated the coloniality of artificial intelligence (AI) development and
deployment through mechanisms such as extractivism, automation, sociological …

Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation

A Smart, D Wang, E Monk, M Díaz… - arxiv preprint arxiv …, 2024 - arxiv.org
Data annotation remains the sine qua non of machine learning and AI. Recent empirical
work on data annotation has begun to highlight the importance of rater diversity for fairness …

CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models

G Pistilli, A Leidinger, Y Jernite, A Kasirzadeh… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper introduces the" CIVICS: Culturally-Informed & Values-Inclusive Corpus for
Societal impacts" dataset, designed to evaluate the social and cultural variation of Large …

Cultural fidelity in large-language models: An evaluation of online language resources as a driver of model performance in value representation

S Kazemi, G Gerhardt, J Katz, CI Kuria, E Pan… - arxiv preprint arxiv …, 2024 - arxiv.org
The training data for LLMs embeds societal values, increasing their familiarity with the
language's culture. Our analysis found that 44% of the variance in the ability of GPT-4o to …

Legal Minds, Algorithmic Decisions: How LLMs Apply Constitutional Principles in Complex Scenarios

C Bignotti, C Camassa - Proceedings of the AAAI/ACM Conference on …, 2024 - ojs.aaai.org
In this paper, we conduct an empirical analysis of how large language models (LLMs),
specifically GPT-4, interpret constitutional principles in complex decision-making scenarios …

Learning When Not to Measure: Theorizing Ethical Alignment in LLMs

W Rathje - Proceedings of the AAAI/ACM Conference on AI, Ethics …, 2024 - ojs.aaai.org
LLMs and other forms of generative AI have shown immense promise in producing highly
accurate epistemic judgements in domains as varied as law, education, and medicine–with …

What's the most important value? INVP: INvestigating the Value Priorities of LLMs through Decision-making in Social Scenarios

X Liu, P Liu, D Yu - … of the 31st International Conference on …, 2025 - aclanthology.org
As large language models (LLMs) demonstrate impressive performance in various tasks and
are increasingly integrated into the decision-making process, ensuring they align with …