Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arxiv preprint arxiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Fairness and bias in multimodal ai: A survey

T Adewumi, L Alkhaled, N Gurung, G van Boven… - arxiv preprint arxiv …, 2024 - arxiv.org
The importance of addressing fairness and bias in artificial intelligence (AI) systems cannot
be over-emphasized. Mainstream media has been awashed with news of incidents around …

A survey of large language models for european languages

W Ali, S Pyysalo - arxiv preprint arxiv:2408.15040, 2024 - arxiv.org
Large Language Models (LLMs) have gained significant attention due to their high
performance on a wide range of natural language tasks since the release of ChatGPT. The …

Emma-500: Enhancing massively multilingual adaptation of large language models

S Ji, Z Li, I Paul, J Paavola, P Lin, P Chen… - arxiv preprint arxiv …, 2024 - arxiv.org
In this work, we introduce EMMA-500, a large-scale multilingual language model continue-
trained on texts across 546 languages designed for enhanced multilingual performance …

Scisafeeval: a comprehensive benchmark for safety alignment of large language models in scientific tasks

T Li, J Lu, C Chu, T Zeng, Y Zheng, M Li… - arxiv preprint arxiv …, 2024 - arxiv.org
Large language models (LLMs) have had a transformative impact on a variety of scientific
tasks across disciplines such as biology, chemistry, medicine, and physics. However …

Speech Recognition With LLMs Adapted to Disordered Speech Using Reinforcement Learning

C Nagpal, S Venugopalan, J Tobin, M Ladewig… - arxiv preprint arxiv …, 2024 - arxiv.org
We introduce a large language model (LLM) capable of processing speech inputs and show
that tuning it further with reinforcement learning on human preference (RLHF) enables it to …

STAR: SocioTechnical Approach to Red Teaming Language Models

L Weidinger, J Mellor, BG Pegueroles… - arxiv preprint arxiv …, 2024 - arxiv.org
This research introduces STAR, a sociotechnical framework that improves on current best
practices for red teaming safety of large language models. STAR makes two key …

Generative AI and Teachers--For Us or Against Us? A Case Study

J Pettersson, E Hult, T Eriksson, T Adewumi - arxiv preprint arxiv …, 2024 - arxiv.org
We present insightful results of a survey on the adoption of generative artificial intelligence
(GenAI) by university teachers in their teaching activities. The transformation of education by …