Contemporary approaches in evolving language models

D Oralbekova, O Mamyrbayev, M Othman… - Applied Sciences, 2023 - mdpi.com
This article provides a comprehensive survey of contemporary language modeling
approaches within the realm of natural language processing (NLP) tasks. This paper …

Towards measuring and modeling" culture" in llms: A survey

MF Adilazuarda, S Mukherjee, P Lavania… - arxiv preprint arxiv …, 2024 - arxiv.org
We present a survey of more than 90 recent papers that aim to study cultural representation
and inclusion in large language models (LLMs). We observe that none of the studies …

Bias assessment and mitigation in llm-based code generation

D Huang, Q Bu, J Zhang, X **e, J Chen… - arxiv preprint arxiv …, 2023 - arxiv.org
Utilizing state-of-the-art Large Language Models (LLMs), automatic code generation models
play a pivotal role in enhancing the productivity and efficiency of software development …

KoBBQ: Korean Bias Benchmark for Question Answering

J **, J Kim, N Lee, H Yoo, A Oh, H Lee - Transactions of the …, 2024 - direct.mit.edu
Warning: This paper contains examples of stereotypes and biases. The Bias Benchmark for
Question Answering (BBQ) is designed to evaluate social biases of language models (LMs) …

Prompt packer: Deceiving llms through compositional instruction with hidden attacks

S Jiang, X Chen, R Tang - arxiv preprint arxiv:2310.10077, 2023 - arxiv.org
Recently, Large language models (LLMs) with powerful general capabilities have been
increasingly integrated into various Web applications, while undergoing alignment training …

Understanding human-AI workflows for generating personas

J Shin, MA Hedderich, BJ Rey, A Lucero… - Proceedings of the 2024 …, 2024 - dl.acm.org
One barrier to deeper adoption of user-research methods is the amount of labor required to
create high-quality representations of collected data. Trained user researchers need to …

[PDF][PDF] Are large multimodal foundation models all we need? On opportunities and challenges of these models in education

S Küchemann, KE Avila, Y Dinc, C Hortmann… - EdAr**v, 2024 - researchgate.net
Large language models have made great advances in the past years, creating compelling
responses to extended verbal inputs. After the release of ChatGPT 3.5, researchers have …

Survey of cultural awareness in language models: Text and beyond

S Pawar, J Park, J **, A Arora, J Myung… - arxiv preprint arxiv …, 2024 - arxiv.org
Large-scale deployment of large language models (LLMs) in various applications, such as
chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure …

PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning

G Kim, D Jang, E Yang - arxiv preprint arxiv:2402.12842, 2024 - arxiv.org
Recent advancements in large language models (LLMs) have raised concerns about
inference costs, increasing the need for research into model compression. While knowledge …

OccuQuest: Mitigating Occupational Bias for Inclusive Large Language Models

M Xue, D Liu, K Yang, G Dong, W Lei, Z Yuan… - arxiv preprint arxiv …, 2023 - arxiv.org
The emergence of large language models (LLMs) has revolutionized natural language
processing tasks. However, existing instruction-tuning datasets suffer from occupational …