Foundation and large language models: fundamentals, challenges, opportunities, and social impacts

D Myers, R Mohawesh, VI Chellaboina, AL Sathvik… - Cluster …, 2024 - Springer
Abstract Foundation and Large Language Models (FLLMs) are models that are trained using
a massive amount of data with the intent to perform a variety of downstream tasks. FLLMs …

Large language models encode clinical knowledge

K Singhal, S Azizi, T Tu, SS Mahdavi, J Wei… - arxiv preprint arxiv …, 2022 - arxiv.org
Large language models (LLMs) have demonstrated impressive capabilities in natural
language understanding and generation, but the quality bar for medical and clinical …

On the opportunities and risks of foundation models

R Bommasani, DA Hudson, E Adeli, R Altman… - arxiv preprint arxiv …, 2021 - arxiv.org
AI is undergoing a paradigm shift with the rise of models (eg, BERT, DALL-E, GPT-3) that are
trained on broad data at scale and are adaptable to a wide range of downstream tasks. We …

Picking on the same person: Does algorithmic monoculture lead to outcome homogenization?

R Bommasani, KA Creel, A Kumar… - Advances in …, 2022 - proceedings.neurips.cc
As the scope of machine learning broadens, we observe a recurring theme of algorithmic
monoculture: the same systems, or systems that share components (eg datasets, models) …

[BOEK][B] Fairness and machine learning: Limitations and opportunities

S Barocas, M Hardt, A Narayanan - 2023 - books.google.com
An introduction to the intellectual foundations and practical utility of the recent work on
fairness and machine learning. Fairness and Machine Learning introduces advanced …

Towards intersectionality in machine learning: Including more identities, handling underrepresentation, and performing evaluation

A Wang, VV Ramaswamy, O Russakovsky - Proceedings of the 2022 …, 2022 - dl.acm.org
Research in machine learning fairness has historically considered a single binary
demographic attribute; however, the reality is of course far more complicated. In this work …

Understanding and evaluating racial biases in image captioning

D Zhao, A Wang… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Image captioning is an important task for benchmarking visual reasoning and for enabling
accessibility for people with vision impairments. However, as in many machine learning …

Model multiplicity: Opportunities, concerns, and solutions

E Black, M Raghavan, S Barocas - … of the 2022 ACM Conference on …, 2022 - dl.acm.org
Recent scholarship has brought attention to the fact that there often exist multiple models for
a given prediction task with equal accuracy that differ in their individual-level predictions or …

Does Writing with Language Models Reduce Content Diversity?

V Padmakumar, H He - arxiv preprint arxiv:2309.05196, 2023 - arxiv.org
Large language models (LLMs) have led to a surge in collaborative writing with model
assistance. As different users incorporate suggestions from the same model, there is a risk of …

Ecosystem-level analysis of deployed machine learning reveals homogeneous outcomes

C Toups, R Bommasani, K Creel… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Machine learning is traditionally studied at the model level: researchers measure
and improve the accuracy, robustness, bias, efficiency, and other dimensions of specific …