A survey of the usages of deep learning for natural language processing

DW Otter, JR Medina, JK Kalita - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

Neural machine translation: A review

F Stahlberg - Journal of Artificial Intelligence Research, 2020 - jair.org
The field of machine translation (MT), the automatic translation of written text from one
natural language into another, has experienced a major paradigm shift in recent years …

From recognition to cognition: Visual commonsense reasoning

R Zellers, Y Bisk, A Farhadi… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Visual understanding goes well beyond object recognition. With one glance at an image, we
can effortlessly imagine the world beyond the pixels: for instance, we can infer people's …

Survey of post-OCR processing approaches

TTH Nguyen, A Jatowt, M Coustaty… - ACM Computing Surveys …, 2021 - dl.acm.org
Optical character recognition (OCR) is one of the most popular techniques used for
converting printed documents into machine-readable ones. While OCR engines can do well …

Adversarial attacks on deep-learning models in natural language processing: A survey

WE Zhang, QZ Sheng, A Alhazmi, C Li - ACM Transactions on Intelligent …, 2020 - dl.acm.org
With the development of high computational devices, deep neural networks (DNNs), in
recent years, have gained significant popularity in many Artificial Intelligence (AI) …

A call for clarity in reporting BLEU scores

M Post - arxiv preprint arxiv:1804.08771, 2018 - arxiv.org
The field of machine translation faces an under-recognized problem because of
inconsistency in the reporting of scores from its dominant metric. Although people refer to" …

Root mean square layer normalization

B Zhang, R Sennrich - Advances in Neural Information …, 2019 - proceedings.neurips.cc
Layer normalization (LayerNorm) has been successfully applied to various deep neural
networks to help stabilize training and boost model convergence because of its capability in …

Adversarial example generation with syntactically controlled paraphrase networks

M Iyyer, J Wieting, K Gimpel, L Zettlemoyer - arxiv preprint arxiv …, 2018 - arxiv.org
We propose syntactically controlled paraphrase networks (SCPNs) and use them to
generate adversarial examples. Given a sentence and a target syntactic form (eg, a …

Synthetic and natural noise both break neural machine translation

Y Belinkov, Y Bisk - arxiv preprint arxiv:1711.02173, 2017 - arxiv.org
Character-based neural machine translation (NMT) models alleviate out-of-vocabulary
issues, learn morphology, and move us closer to completely end-to-end translation systems …

Findings of the 2017 conference on machine translation (wmt17)

O Bojar, R Chatterjee, C Federmann, Y Graham… - 2017 - doras.dcu.ie
This paper presents the results of the WMT17 shared tasks, which included three machine
translation (MT) tasks (news, biomedical, and multimodal), two evaluation tasks (metrics and …