Are Large Language Models Consistent over Value-laden Questions?
Large language models (LLMs) appear to bias their survey answers toward certain values.
Nonetheless, some argue that LLMs are too inconsistent to simulate particular values. Are …
Nonetheless, some argue that LLMs are too inconsistent to simulate particular values. Are …
[HTML][HTML] Normad: A benchmark for measuring the cultural adaptability of large language models
Maarten Sap - Publications Maarten Sap Publications Contact About Me CV Notes/Blogposts
Applying to grad school Giving feedback for talks Notes from my 2020 Academic Job Search …
Applying to grad school Giving feedback for talks Notes from my 2020 Academic Job Search …
Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experiment
Large language models (LLMs) increasingly find their way into the most diverse areas of our
everyday lives. They indirectly influence people's decisions or opinions through their daily …
everyday lives. They indirectly influence people's decisions or opinions through their daily …
Decolonial AI Alignment: Openness, Viśesa-Dharma, and Including Excluded Knowledges
KR Varshney - Proceedings of the AAAI/ACM Conference on AI, Ethics …, 2024 - ojs.aaai.org
Prior work has explicated the coloniality of artificial intelligence (AI) development and
deployment through mechanisms such as extractivism, automation, sociological …
deployment through mechanisms such as extractivism, automation, sociological …
Discipline and Label: A WEIRD Genealogy and Social Theory of Data Annotation
Data annotation remains the sine qua non of machine learning and AI. Recent empirical
work on data annotation has begun to highlight the importance of rater diversity for fairness …
work on data annotation has begun to highlight the importance of rater diversity for fairness …
CIVICS: Building a Dataset for Examining Culturally-Informed Values in Large Language Models
This paper introduces the" CIVICS: Culturally-Informed & Values-Inclusive Corpus for
Societal impacts" dataset, designed to evaluate the social and cultural variation of Large …
Societal impacts" dataset, designed to evaluate the social and cultural variation of Large …
Cultural fidelity in large-language models: An evaluation of online language resources as a driver of model performance in value representation
S Kazemi, G Gerhardt, J Katz, CI Kuria, E Pan… - arxiv preprint arxiv …, 2024 - arxiv.org
The training data for LLMs embeds societal values, increasing their familiarity with the
language's culture. Our analysis found that 44% of the variance in the ability of GPT-4o to …
language's culture. Our analysis found that 44% of the variance in the ability of GPT-4o to …
Legal Minds, Algorithmic Decisions: How LLMs Apply Constitutional Principles in Complex Scenarios
C Bignotti, C Camassa - Proceedings of the AAAI/ACM Conference on …, 2024 - ojs.aaai.org
In this paper, we conduct an empirical analysis of how large language models (LLMs),
specifically GPT-4, interpret constitutional principles in complex decision-making scenarios …
specifically GPT-4, interpret constitutional principles in complex decision-making scenarios …
Learning When Not to Measure: Theorizing Ethical Alignment in LLMs
W Rathje - Proceedings of the AAAI/ACM Conference on AI, Ethics …, 2024 - ojs.aaai.org
LLMs and other forms of generative AI have shown immense promise in producing highly
accurate epistemic judgements in domains as varied as law, education, and medicine–with …
accurate epistemic judgements in domains as varied as law, education, and medicine–with …
What's the most important value? INVP: INvestigating the Value Priorities of LLMs through Decision-making in Social Scenarios
X Liu, P Liu, D Yu - … of the 31st International Conference on …, 2025 - aclanthology.org
As large language models (LLMs) demonstrate impressive performance in various tasks and
are increasingly integrated into the decision-making process, ensuring they align with …
are increasingly integrated into the decision-making process, ensuring they align with …