A survey of the usages of deep learning for natural language processing
Over the last several years, the field of natural language processing has been propelled
forward by an explosion in the use of deep learning models. This article provides a brief …
forward by an explosion in the use of deep learning models. This article provides a brief …
[HTML][HTML] A survey on the application of recurrent neural networks to statistical language modeling
In this paper, we present a survey on the application of recurrent neural networks to the task
of statistical language modeling. Although it has been shown that these models obtain good …
of statistical language modeling. Although it has been shown that these models obtain good …
Testing the correlation of word error rate and perplexity
Many groups have investigated the relationship of word error rate and perplexity of
language models. This issue is of central interest because perplexity optimization can be …
language models. This issue is of central interest because perplexity optimization can be …
[PDF][PDF] Evaluation metrics for language models
The most widely-used evaluation metric for language models for speech recognition is the
perplexity of test data. While perplexities can be calculated efficiently and without access to …
perplexity of test data. While perplexities can be calculated efficiently and without access to …
[PDF][PDF] Log-linear interpolation of language models.
D Klakow - ICSLP, 1998 - Citeseer
Log-Linear Interpolation Of Language Models Page 1 LOG-LINEAR INTERPOLATION OF
LANGUAGE MODELS Dietrich Klakow Philips GmbH Forschungslaboratorien, Wei hausstr.2 …
LANGUAGE MODELS Dietrich Klakow Philips GmbH Forschungslaboratorien, Wei hausstr.2 …
Promise and Peril of Collaborative Code Generation Models: Balancing Effectiveness and Memorization
Z Chen, L Jiang - Proceedings of the 39th IEEE/ACM International …, 2024 - dl.acm.org
In the rapidly evolving field of machine learning, training models with datasets from various
locations and organizations presents significant challenges due to privacy and legal …
locations and organizations presents significant challenges due to privacy and legal …
A neural syntactic language model
A Emami, F Jelinek - Machine learning, 2005 - Springer
This paper presents a study of using neural probabilistic models in a syntactic based
language model. The neural probabilistic model makes use of a distributed representation of …
language model. The neural probabilistic model makes use of a distributed representation of …
[HTML][HTML] Are some words worth more than others?
Current evaluation metrics for language modeling and generation rely heavily on the
accuracy of predicted (or generated) words as compared to a reference ground truth. While …
accuracy of predicted (or generated) words as compared to a reference ground truth. While …
Web resources for language modeling in conversational speech recognition
This article describes a methodology for collecting text from the Web to match a target
sublanguage both in style (register) and topic. Unlike other work that estimates n-gram …
sublanguage both in style (register) and topic. Unlike other work that estimates n-gram …
Scalable language model adaptation for spoken dialogue systems
Language models (LM) for interactive speech recognition systems are trained on large
amounts of data and the model parameters are optimized on past user data. New …
amounts of data and the model parameters are optimized on past user data. New …