A review of sentiment analysis research in Arabic language

O Oueslati, E Cambria, MB HajHmida… - Future Generation …, 2020‏ - Elsevier
Sentiment analysis is a task of natural language processing that has recently attracted
increasing attention. However, sentiment analysis research has mainly been carried out for …

Visualizing transformers for nlp: a brief survey

AMP Braşoveanu, R Andonie - 2020 24th International …, 2020‏ - ieeexplore.ieee.org
The introduction of Transformer neural networks has changed the landscape of Natural
Language Processing during the last three years. While models inspired by it have …

On the dangers of stochastic parrots: Can language models be too big?🦜

EM Bender, T Gebru, A McMillan-Major… - Proceedings of the 2021 …, 2021‏ - dl.acm.org
The past 3 years of work in NLP have been characterized by the development and
deployment of ever larger language models, especially for English. BERT, its variants, GPT …

Five sources of bias in natural language processing

D Hovy, S Prabhumoye - Language and linguistics compass, 2021‏ - Wiley Online Library
Recently, there has been an increased interest in demographically grounded bias in natural
language processing (NLP) applications. Much of the recent work has focused on describing …

Maria: Spanish language models

A Gutiérrez-Fandiño, J Armengol-Estapé… - arxiv preprint arxiv …, 2021‏ - arxiv.org
This work presents MarIA, a family of Spanish language models and associated resources
made available to the industry and the research community. Currently, MarIA includes …

Pre-training is a hot topic: Contextualized document embeddings improve topic coherence

F Bianchi, S Terragni, D Hovy - arxiv preprint arxiv:2004.03974, 2020‏ - arxiv.org
Topic models extract groups of words from documents, whose interpretation as a topic
hopefully allows for a better understanding of the data. However, the resulting word groups …

An effective BERT-based pipeline for Twitter sentiment analysis: A case study in Italian

M Pota, M Ventura, R Catelli, M Esposito - Sensors, 2020‏ - mdpi.com
Over the last decade industrial and academic communities have increased their focus on
sentiment analysis techniques, especially applied to tweets. State-of-the-art results have …

[PDF][PDF] HONEST: Measuring hurtful sentence completion in language models

D Nozza, F Bianchi, D Hovy - … of the 2021 Conference of the …, 2021‏ - iris.unibocconi.it
Abstract Language models have revolutionized the field of NLP. However, language models
capture and proliferate hurtful stereotypes, especially in text generation. Our results show …

RoBERTuito: a pre-trained language model for social media text in Spanish

JM Pérez, DA Furman, LA Alemany, F Luque - arxiv preprint arxiv …, 2021‏ - arxiv.org
Since BERT appeared, Transformer language models and transfer learning have become
state-of-the-art for Natural Language Understanding tasks. Recently, some works geared …

Cross-lingual contextualized topic models with zero-shot learning

F Bianchi, S Terragni, D Hovy, D Nozza… - arxiv preprint arxiv …, 2020‏ - arxiv.org
Many data sets (eg, reviews, forums, news, etc.) exist parallelly in multiple languages. They
all cover the same content, but the linguistic differences make it impossible to use traditional …