Foundational challenges in assuring alignment and safety of large language models
This work identifies 18 foundational challenges in assuring the alignment and safety of large
language models (LLMs). These challenges are organized into three different categories …
language models (LLMs). These challenges are organized into three different categories …
Implicit bias in large language models: Experimental proof and implications for education
We provide experimental evidence of implicit racial bias in a large language model
(specifically ChatGPT 3.5) in the context of an educational task and discuss implications for …
(specifically ChatGPT 3.5) in the context of an educational task and discuss implications for …
[PDF][PDF] Is “A Helpful Assistant” the Best Role for Large Language Models? A Systematic Evaluation of Social Roles in System Prompts
Prompting serves as the major way humans interact with Large Language Models (LLM).
Commercial AI systems commonly define the role of the LLM in system prompts. For …
Commercial AI systems commonly define the role of the LLM in system prompts. For …
Impact of an adaptive dialog that uses natural language processing to detect students' ideas and guide knowledge integration.
This study leverages natural language processing (NLP) to deepen our understanding of
how students integrate their ideas about genetic inheritance while engaging in an adaptive …
how students integrate their ideas about genetic inheritance while engaging in an adaptive …
Human and LLM Biases in Hate Speech Annotations: A Socio-Demographic Analysis of Annotators and Targets
The rise of online platforms exacerbated the spread of hate speech, demanding scalable
and effective detection. However, the accuracy of hate speech detection systems heavily …
and effective detection. However, the accuracy of hate speech detection systems heavily …
Large language models cannot replace human participants because they cannot portray identity groups
Large language models (LLMs) are increasing in capability and popularity, propelling their
application in new domains--including as replacements for human participants in …
application in new domains--including as replacements for human participants in …
LLMs generate structurally realistic social networks but overestimate political homophily
Generating social networks is essential for many applications, such as epidemic modeling
and social simulations. Prior approaches either involve deep learning models, which require …
and social simulations. Prior approaches either involve deep learning models, which require …
From persona to personalization: A survey on role-playing language agents
Recent advancements in large language models (LLMs) have significantly boosted the rise
of Role-Playing Language Agents (RPLAs), ie, specialized AI systems designed to simulate …
of Role-Playing Language Agents (RPLAs), ie, specialized AI systems designed to simulate …
Bias and toxicity in role-play reasoning
Role-play in the Large Language Model (LLM) is a crucial technique that enables models to
adopt specific perspectives, enhancing their ability to generate contextually relevant and …
adopt specific perspectives, enhancing their ability to generate contextually relevant and …
Personagym: Evaluating persona agents and llms
Persona agents, which are LLM agents that act according to an assigned persona, have
demonstrated impressive contextual response capabilities across various applications …
demonstrated impressive contextual response capabilities across various applications …