A survey of the usages of deep learning for natural language processing

DW Otter, JR Medina, JK Kalita - IEEE transactions on neural …, 2020 - ieeexplore.ieee.org
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …

[HTML][HTML] A survey on the application of recurrent neural networks to statistical language modeling

W De Mulder, S Bethard, MF Moens - Computer Speech & Language, 2015 - Elsevier
In this paper, we present a survey on the application of recurrent neural networks to the task
of statistical language modeling. Although it has been shown that these models obtain good …

Testing the correlation of word error rate and perplexity

D Klakow, J Peters - Speech Communication, 2002 - Elsevier
Many groups have investigated the relationship of word error rate and perplexity of
language models. This issue is of central interest because perplexity optimization can be …

[PDF][PDF] Evaluation metrics for language models

SF Chen, D Beeferman, R Rosenfeld - 1998 - kilthub.cmu.edu
The most widely-used evaluation metric for language models for speech recognition is the
perplexity of test data. While perplexities can be calculated efficiently and without access to …

[PDF][PDF] Log-linear interpolation of language models.

D Klakow - ICSLP, 1998 - Citeseer
Log-Linear Interpolation Of Language Models Page 1 LOG-LINEAR INTERPOLATION OF
LANGUAGE MODELS Dietrich Klakow Philips GmbH Forschungslaboratorien, Wei hausstr.2 …

Promise and Peril of Collaborative Code Generation Models: Balancing Effectiveness and Memorization

Z Chen, L Jiang - Proceedings of the 39th IEEE/ACM International …, 2024 - dl.acm.org
In the rapidly evolving field of machine learning, training models with datasets from various
locations and organizations presents significant challenges due to privacy and legal …

A neural syntactic language model

A Emami, F Jelinek - Machine learning, 2005 - Springer
This paper presents a study of using neural probabilistic models in a syntactic based
language model. The neural probabilistic model makes use of a distributed representation of …

[HTML][HTML] Are some words worth more than others?

S Dudy, S Bedrick - Proceedings of the Conference on Empirical …, 2020 - ncbi.nlm.nih.gov
Current evaluation metrics for language modeling and generation rely heavily on the
accuracy of predicted (or generated) words as compared to a reference ground truth. While …

Web resources for language modeling in conversational speech recognition

I Bulyko, M Ostendorf, M Siu, T Ng, A Stolcke… - ACM Transactions on …, 2007 - dl.acm.org
This article describes a methodology for collecting text from the Web to match a target
sublanguage both in style (register) and topic. Unlike other work that estimates n-gram …

Scalable language model adaptation for spoken dialogue systems

A Gandhe, A Rastrow… - 2018 IEEE Spoken …, 2018 - ieeexplore.ieee.org
Language models (LM) for interactive speech recognition systems are trained on large
amounts of data and the model parameters are optimized on past user data. New …