As language models (LMs) scale, they develop many novel behaviors, good and bad,
exacerbating the need to evaluate how they behave. Prior work creates evaluations with …

Recent work demonstrates the potential of multilingual pretraining of creating one model that
can be used for various tasks in different languages. Previous work in multilingual …

Existing multilingual machine translation approaches mainly focus on English-centric
directions, while the non-English directions still lag behind. In this work, we aim to build a …

This work focuses on sign language retrieval--a recently proposed task for sign language
understanding. Sign language retrieval consists of two sub-tasks: text-to-sign-video (T2V) …

Scaling semantic parsing models for task-oriented dialog systems to new languages is often
expensive and time-consuming due to the lack of available datasets. Available datasets …

We describe Facebook's multilingual model submission to the WMT2021 shared task on
news translation. We participate in 14 language directions: English to and from Czech …

Recent studies have demonstrated that pre-trained cross-lingual models achieve impressive
performance in downstream cross-lingual tasks. This improvement benefits from learning a …

Abstract We present Cross-lingual Open-Retrieval Answer Generation (CORA), the first
unified many-to-many question answering (QA) model that can answer questions across …

End-to-end speech translation models have become a new trend in research due to their
potential of reducing error propagation. However, these models still suffer from the …

Previous work mainly focuses on improving cross-lingual transfer for NLU tasks with a
multilingual pretrained encoder (MPE), or improving the performance on supervised …