Topic modeling algorithms and applications: A survey

A Abdelrazek, Y Eid, E Gawish, W Medhat, A Hassan - Information Systems, 2023 - Elsevier
Topic modeling is used in information retrieval to infer the hidden themes in a collection of
documents and thus provides an automatic means to organize, understand and summarize …

Advances in variational inference

C Zhang, J Bütepage, H Kjellström… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
Many modern unsupervised or semi-supervised machine learning algorithms rely on
Bayesian probabilistic models. These models are usually intractable and thus require …

Virtual adversarial training: a regularization method for supervised and semi-supervised learning

T Miyato, S Maeda, M Koyama… - IEEE transactions on …, 2018 - ieeexplore.ieee.org
We propose a new regularization method based on virtual adversarial loss: a new measure
of local smoothness of the conditional label distribution given input. Virtual adversarial loss …

Topic modeling in embedding spaces

AB Dieng, FJR Ruiz, DM Blei - Transactions of the Association for …, 2020 - direct.mit.edu
Topic modeling analyzes documents to learn meaningful patterns of words. However,
existing topic models fail to learn interpretable topics when working with large and heavy …

Pre-training is a hot topic: Contextualized document embeddings improve topic coherence

F Bianchi, S Terragni, D Hovy - arxiv preprint arxiv:2004.03974, 2020 - arxiv.org
Topic models extract groups of words from documents, whose interpretation as a topic
hopefully allows for a better understanding of the data. However, the resulting word groups …

Topicgpt: A prompt-based topic modeling framework

CM Pham, A Hoyle, S Sun, P Resnik, M Iyyer - arxiv preprint arxiv …, 2023 - arxiv.org
Topic modeling is a well-established technique for exploring text corpora. Conventional
topic models (eg, LDA) represent topics as bags of words that often require" reading the tea …

Topic modelling meets deep neural networks: A survey

H Zhao, D Phung, V Huynh, Y **, L Du… - arxiv preprint arxiv …, 2021 - arxiv.org
Topic modelling has been a successful technique for text analysis for almost twenty years.
When topic modelling met deep neural networks, there emerged a new and increasingly …

Topic-driven and knowledge-aware transformer for dialogue emotion detection

L Zhu, G Pergola, L Gui, D Zhou, Y He - arxiv preprint arxiv:2106.01071, 2021 - arxiv.org
Emotion detection in dialogues is challenging as it often requires the identification of
thematic topics underlying a conversation, the relevant commonsense knowledge, and the …

OCTIS: Comparing and optimizing topic models is simple!

S Terragni, E Fersini, BG Galuzzi… - Proceedings of the …, 2021 - aclanthology.org
In this paper, we present OCTIS, a framework for training, analyzing, and comparing Topic
Models, whose optimal hyper-parameters are estimated using a Bayesian Optimization …

Implicit reparameterization gradients

M Figurnov, S Mohamed… - Advances in neural …, 2018 - proceedings.neurips.cc
By providing a simple and efficient way of computing low-variance gradients of continuous
random variables, the reparameterization trick has become the technique of choice for …