Analysis methods in neural language processing: A survey

Y Belinkov, J Glass - … of the Association for Computational Linguistics, 2019 - direct.mit.edu
The field of natural language processing has seen impressive progress in recent years, with
neural network models replacing many of the traditional systems. A plethora of new models …

Intrinsic bias metrics do not correlate with application bias

S Goldfarb-Tarrant, R Marchant, RM Sánchez… - arxiv preprint arxiv …, 2020 - arxiv.org
Natural Language Processing (NLP) systems learn harmful societal biases that cause them
to amplify inequality as they are deployed in more and more situations. To guide efforts at …

From word to sense embeddings: A survey on vector representations of meaning

J Camacho-Collados, MT Pilehvar - Journal of Artificial Intelligence …, 2018 - jair.org
Over the past years, distributed semantic representations have proved to be effective and
flexible keepers of prior knowledge to be integrated into downstream applications. This …

Interpreting pretrained contextualized representations via reductions to static embeddings

R Bommasani, K Davis, C Cardie - … of the 58th Annual Meeting of …, 2020 - aclanthology.org
Contextualized representations (eg ELMo, BERT) have become the default pretrained
representations for downstream NLP applications. In some settings, this transition has …