Arabic is recognised as the 4th most used language of the Internet. Arabic has three main
varieties:(1) classical Arabic (CA),(2) Modern Standard Arabic (MSA),(3) Arabic Dialect (AD) …

As online false information continues to grow, automated fact‐checking has gained an
increasing amount of attention in recent years. Researchers in the field of Natural Language …

As the reach of large language models (LMs) expands globally, their ability to cater to
diverse cultural contexts becomes crucial. Despite advancements in multilingual …

The Arabic language is a morphologically rich language with relatively few resources and a
less explored syntax compared to English. Given these limitations, Arabic Natural Language …

Text preprocessing is not only an essential step to prepare the corpus for modeling but also
a key area that directly affects the natural language processing (NLP) application results. For …

In this paper, we explore the effects of language variants, data sizes, and fine-tuning task
types in Arabic pre-trained language models. To do so, we build three pre-trained language …

In this work, we provide a systematic and comprehensive empirical comparison of pretrained
multilingual language models versus their monolingual counterparts with regard to their …

Abstract We present CAMeL Tools, a collection of open-source tools for Arabic natural
language processing in Python. CAMeL Tools currently provides utilities for pre-processing …

Recent advancements in Large Language Models (LLMs) have significantly influenced the
landscape of language and speech research. Despite this progress, these models lack …

Pretraining Bidirectional Encoder Representations from Transformers (BERT) for
downstream NLP tasks is a non-trival task. We pretrained 5 BERT models that differ in the …