Topic modeling algorithms and applications: A survey

A Abdelrazek, Y Eid, E Gawish, W Medhat, A Hassan - Information Systems, 2023 - Elsevier
Topic modeling is used in information retrieval to infer the hidden themes in a collection of
documents and thus provides an automatic means to organize, understand and summarize …

A systematic review of the use of topic models for short text social media analysis

CDP Laureate, W Buntine, H Linger - Artificial Intelligence Review, 2023 - Springer
Recently, research on short text topic models has addressed the challenges of social media
datasets. These models are typically evaluated using automated measures. However, recent …

BERTopic: Neural topic modeling with a class-based TF-IDF procedure

M Grootendorst - arxiv preprint arxiv:2203.05794, 2022 - arxiv.org
Topic models can be useful tools to discover latent topics in collections of documents.
Recent studies have shown the feasibility of approach topic modeling as a clustering task …

Pre-training is a hot topic: Contextualized document embeddings improve topic coherence

F Bianchi, S Terragni, D Hovy - arxiv preprint arxiv:2004.03974, 2020 - arxiv.org
Topic models extract groups of words from documents, whose interpretation as a topic
hopefully allows for a better understanding of the data. However, the resulting word groups …

Is neural topic modelling better than clustering? An empirical study on clustering with contextual embeddings for topics

Z Zhang, M Fang, L Chen, MR Namazi-Rad - arxiv preprint arxiv …, 2022 - arxiv.org
Recent work incorporates pre-trained word embeddings such as BERT embeddings into
Neural Topic Models (NTMs), generating highly coherent topics. However, with high-quality …

Effective neural topic modeling with embedding clustering regularization

X Wu, X Dong, TT Nguyen… - … Conference on Machine …, 2023 - proceedings.mlr.press
Topic models have been prevalent for decades with various applications. However, existing
topic models commonly suffer from the notorious topic collapsing: discovered topics …

A survey on neural topic models: methods, applications, and challenges

X Wu, T Nguyen, AT Luu - Artificial Intelligence Review, 2024 - Springer
Topic models have been prevalent for decades to discover latent topics and infer topic
proportions of documents in an unsupervised fashion. They have been widely used in …

Topic modeling revisited: A document graph-based neural network perspective

D Shen, C Qin, C Wang, Z Dong… - Advances in neural …, 2021 - proceedings.neurips.cc
Most topic modeling approaches are based on the bag-of-words assumption, where each
word is required to be conditionally independent in the same document. As a result, both of …

Neural topic model via optimal transport

H Zhao, D Phung, V Huynh, T Le, W Buntine - arxiv preprint arxiv …, 2020 - arxiv.org
Recently, Neural Topic Models (NTMs) inspired by variational autoencoders have obtained
increasingly research interest due to their promising results on text analysis. However, it is …

Sawtooth factorial topic embeddings guided gamma belief network

Z Duan, D Wang, B Chen, C Wang… - International …, 2021 - proceedings.mlr.press
Hierarchical topic models such as the gamma belief network (GBN) have delivered
promising results in mining multi-layer document representations and discovering …