Challenges and applications of large language models

J Kaddour, J Harris, M Mozes, H Bradley… - ar** artificial learning systems that can understand and generate natural language
has been one of the long-standing goals of artificial intelligence. Recent decades have …

A primer on pretrained multilingual language models

S Doddapaneni, G Ramesh, MM Khapra… - arxiv preprint arxiv …, 2021 - arxiv.org
Multilingual Language Models (\MLLMs) such as mBERT, XLM, XLM-R,\textit {etc.} have
emerged as a viable option for bringing the power of pretraining to a large number of …

Compositional evaluation on Japanese textual entailment and similarity

H Yanaka, K Mineshima - Transactions of the Association for …, 2022 - direct.mit.edu
Abstract Natural Language Inference (NLI) and Semantic Textual Similarity (STS) are widely
used benchmark tasks for compositional evaluation of pre-trained language models. Despite …