[PDF][PDF] Language model behavior: A comprehensive survey

TA Chang, BK Bergen - Computational Linguistics, 2024 - direct.mit.edu
Transformer language models have received widespread public attention, yet their
generated text is often surprising even to NLP researchers. In this survey, we discuss over …

A survey on fairness in large language models

Y Li, M Du, R Song, X Wang, Y Wang - arxiv preprint arxiv:2308.10149, 2023 - arxiv.org
Large Language Models (LLMs) have shown powerful performance and development
prospects and are widely deployed in the real world. However, LLMs can capture social …

Efficient methods for natural language processing: A survey

M Treviso, JU Lee, T Ji, B Aken, Q Cao… - Transactions of the …, 2023 - direct.mit.edu
Recent work in natural language processing (NLP) has yielded appealing results from
scaling model parameters and training data; however, using only scale to improve …

A survey of text classification with transformers: How wide? how large? how long? how accurate? how expensive? how safe?

J Fields, K Chovanec, P Madiraju - IEEE Access, 2024 - ieeexplore.ieee.org
Text classification in natural language processing (NLP) is evolving rapidly, particularly with
the surge in transformer-based models, including large language models (LLM). This paper …

A survey on gender bias in natural language processing

K Stanczak, I Augenstein - arxiv preprint arxiv:2112.14168, 2021 - arxiv.org
Language can be used as a means of reproducing and enforcing harmful stereotypes and
biases and has been analysed as such in numerous research. In this paper, we present a …

Upstream mitigation is not all you need: Testing the bias transfer hypothesis in pre-trained language models

R Steed, S Panda, A Kobren… - Proceedings of the 60th …, 2022 - aclanthology.org
A few large, homogenous, pre-trained models undergird many machine learning systems—
and often, these models contain harmful stereotypes learned from the internet. We …

Theories of “gender” in nlp bias research

H Devinney, J Björklund, H Björklund - … of the 2022 ACM conference on …, 2022 - dl.acm.org
The rise of concern around Natural Language Processing (NLP) technologies containing
and perpetuating social biases has led to a rich and rapidly growing area of research …

Prompt text classifications with transformer models! An exemplary introduction to prompt-based learning with large language models

CWF Mayer, S Ludwig, S Brandt - Journal of Research on …, 2023 - Taylor & Francis
This study investigates the potential of automated classification using prompt-based learning
approaches with transformer models (large language models trained in an unsupervised …

[PDF][PDF] Bias and fairness in large language models: A survey

IO Gallegos, RA Rossi, J Barrow, MM Tanjim… - Computational …, 2024 - direct.mit.edu
Rapid advancements of large language models (LLMs) have enabled the processing,
understanding, and generation of human-like text, with increasing integration into systems …

[HTML][HTML] From turing to transformers: A comprehensive review and tutorial on the evolution and applications of generative transformer models

EY Zhang, AD Cheok, Z Pan, J Cai, Y Yan - Sci, 2023 - mdpi.com
In recent years, generative transformers have become increasingly prevalent in the field of
artificial intelligence, especially within the scope of natural language processing. This paper …