Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

Universal dependencies (UD) is a framework for morphosyntactic annotation of human
language, which to date has been used to create treebanks for more than 100 languages. In …

Universal Dependencies is an open community effort to create cross-linguistically consistent
treebank annotation for many languages within a dependency-based lexicalist framework …

In this paper, we show that Multilingual BERT (M-BERT), released by Devlin et al.(2018) as
a single language model pre-trained from monolingual corpora in 104 languages, is …

We present FLAIR, an NLP framework designed to facilitate training and distribution of state-
of-the-art sequence labeling, text classification and language models. The core idea of the …

Ancient languages preserve the cultures and histories of the past. However, their study is
fraught with difficulties, and experts must tackle a range of challenging text-based tasks, from …

Although the Indonesian language is spoken by almost 200 million people and the 10th
most spoken language in the world, it is under-represented in NLP research. Previous work …

Deep learning-based language models pretrained on large unannotated text corpora have
been demonstrated to allow efficient transfer learning for natural language processing, with …

Many natural language processing tasks, including the most advanced ones, routinely start
by several basic processing steps–tokenization and segmentation, most likely also POS …

Current state-of-the-art semantic role labeling (SRL) uses a deep neural network with no
explicit linguistic features. However, prior work has shown that gold syntax trees can …