Statistical machine translation

A Lopez - ACM Computing Surveys (CSUR), 2008 - dl.acm.org
Statistical machine translation (SMT) treats the translation of natural language as a machine
learning problem. By examining many samples of human-produced translation, SMT …

Deep semantic role labeling with self-attention

Z Tan, M Wang, J **e, Y Chen, X Shi - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Abstract Semantic Role Labeling (SRL) is believed to be a crucial step towards natural
language understanding and has been widely studied. Recent years, end-to-end SRL with …

Word embedding for understanding natural language: a survey

Y Li, T Yang - Guide to big data applications, 2018 - Springer
Word embedding, where semantic and syntactic features are captured from unlabeled text
data, is a basic procedure in Natural Language Processing (NLP). The extracted features …

[PDF][PDF] Natural language processing (almost) from scratch

R Collobert, J Weston, L Bottou, M Karlen… - 2011 - jmlr.org
We propose a unified neural network architecture and learning algorithm that can be applied
to various natural language processing tasks including part-of-speech tagging, chunking …

[PDF][PDF] Exploiting source-side monolingual data in neural machine translation

J Zhang, C Zong - Proceedings of the 2016 conference on …, 2016 - aclanthology.org
Abstract Neural Machine Translation (NMT) based on the encoder-decoder architecture has
recently become a new paradigm. Researchers have proven that the target-side …

A unified architecture for natural language processing: Deep neural networks with multitask learning

R Collobert, J Weston - Proceedings of the 25th international conference …, 2008 - dl.acm.org
We describe a single convolutional neural network architecture that, given a sentence,
outputs a host of language processing predictions: part-of-speech tags, chunks, named …

Semi-supervised learning for neural machine translation

Y Cheng, Y Cheng - Joint training for neural machine translation, 2019 - Springer
While end-to-end neural machine translation (NMT) has made remarkable progress
recently, NMT systems only rely on parallel corpora for parameter estimation. Since parallel …

Fast domain adaptation for neural machine translation

M Freitag, Y Al-Onaizan - arxiv preprint arxiv:1612.06897, 2016 - arxiv.org
Neural Machine Translation (NMT) is a new approach for automatic translation of text from
one human language into another. The basic concept in NMT is to train a large Neural …

Generate, annotate, and learn: NLP with synthetic text

X He, I Nassar, J Kiros, G Haffari… - Transactions of the …, 2022 - direct.mit.edu
This paper studies the use of language models as a source of synthetic unlabeled text for
NLP. We formulate a general framework called “generate, annotate, and learn (GAL)” to take …

Low-resource neural machine translation improvement using source-side monolingual data

AL Tonja, O Kolesnikova, A Gelbukh, G Sidorov - Applied Sciences, 2023 - mdpi.com
Despite the many proposals to solve the neural machine translation (NMT) problem of low-
resource languages, it continues to be difficult. The issue becomes even more complicated …