A survey of the usages of deep learning for natural language processing

DW Otter, JR Medina, JK Kalita - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

Climbing towards NLU: On meaning, form, and understanding in the age of data

EM Bender, A Koller - Proceedings of the 58th annual meeting of …, 2020 - aclanthology.org
The success of the large neural language models on many NLP tasks is exciting. However,
we find that these successes sometimes lead to hype in which these models are being …

The state of the art in semantic representation

O Abend, A Rappoport - Proceedings of the 55th Annual Meeting …, 2017 - aclanthology.org
Semantic representation is receiving growing attention in NLP in the past few years, and
many proposals for semantic schemes (eg, AMR, UCCA, GMB, UDS) have been put forth …

Linguistic knowledge and transferability of contextual representations

NF Liu, M Gardner, Y Belinkov, ME Peters… - arxiv preprint arxiv …, 2019 - arxiv.org
Contextual word representations derived from large-scale neural language models are
successful across a diverse set of NLP tasks, suggesting that they encode useful and …

Emergent linguistic structure in artificial neural networks trained by self-supervision

CD Manning, K Clark, J Hewitt, U Khandelwal… - Proceedings of the …, 2020 - pnas.org
This paper explores the knowledge of linguistic structure learned by large artificial neural
networks, trained via self-supervision, whereby the model simply tries to predict a masked …

Automated concatenation of embeddings for structured prediction

X Wang, Y Jiang, N Bach, T Wang, Z Huang… - arxiv preprint arxiv …, 2020 - arxiv.org
Pretrained contextualized embeddings are powerful word representations for structured
prediction tasks. Recent work found that better word representations can be obtained by …

AMR parsing as sequence-to-graph transduction

S Zhang, X Ma, K Duh, B Van Durme - arxiv preprint arxiv:1905.08704, 2019 - arxiv.org
We propose an attention-based model that treats AMR parsing as sequence-to-graph
transduction. Unlike most AMR parsers that rely on pre-trained aligners, external semantic …

Simpler but more accurate semantic dependency parsing

T Dozat, CD Manning - arxiv preprint arxiv:1807.01396, 2018 - arxiv.org
While syntactic dependency annotations concentrate on the surface or functional structure of
a sentence, semantic dependency annotations aim to capture between-word relationships …

[PDF][PDF] It depends: Dependency parser comparison using a web-based evaluation tool

JD Choi, J Tetreault, A Stent - … of the 53rd Annual Meeting of the …, 2015 - aclanthology.org
The last few years have seen a surge in the number of accurate, fast, publicly available
dependency parsers. At the same time, the use of dependency parsing in NLP applications …

A survey on semantic parsing

A Kamath, R Das - arxiv preprint arxiv:1812.00978, 2018 - arxiv.org
A significant amount of information in today's world is stored in structured and semi-
structured knowledge bases. Efficient and simple methods to query them are essential and …