A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

A comprehensive survey on deep graph representation learning

W Ju, Z Fang, Y Gu, Z Liu, Q Long, Z Qiao, Y Qin… - Neural Networks, 2024 - Elsevier
Graph representation learning aims to effectively encode high-dimensional sparse graph-
structured data into low-dimensional dense vectors, which is a fundamental task that has …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

A survey on heterogeneous graph embedding: methods, techniques, applications and sources

X Wang, D Bo, C Shi, S Fan, Y Ye… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Heterogeneous graphs (HGs) also known as heterogeneous information networks have
become ubiquitous in real-world scenarios; therefore, HG embedding, which aims to learn …

An overview of deep semi-supervised learning

Y Ouali, C Hudelot, M Tami - arxiv preprint arxiv:2006.05278, 2020 - arxiv.org
Deep neural networks demonstrated their ability to provide remarkable performances on a
wide range of supervised learning tasks (eg, image classification) when trained on extensive …

Unsupervised social bot detection via structural information theory

H Peng, J Zhang, X Huang, Z Hao, A Li, Z Yu… - ACM Transactions on …, 2024 - dl.acm.org
Research on social bot detection plays a crucial role in maintaining the order and reliability
of information dissemination while increasing trust in social interactions. The current …

Graph-based semi-supervised learning: A comprehensive review

Z Song, X Yang, Z Xu, I King - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
Semi-supervised learning (SSL) has tremendous value in practice due to the utilization of
both labeled and unlabelled data. An essential class of SSL methods, referred to as graph …

Multi-scale attributed node embedding

B Rozemberczki, C Allen… - Journal of Complex …, 2021 - academic.oup.com
We present network embedding algorithms that capture information about a node from the
local distribution over node attributes around it, as observed over random walks following an …

Graph representation learning via graphical mutual information maximization

Z Peng, W Huang, M Luo, Q Zheng, Y Rong… - Proceedings of The …, 2020 - dl.acm.org
The richness in the content of various information networks such as social networks and
communication networks provides the unprecedented potential for learning high-quality …

A survey of graph neural networks in various learning paradigms: methods, applications, and challenges

L Waikhom, R Patgiri - Artificial Intelligence Review, 2023 - Springer
In the last decade, deep learning has reinvigorated the machine learning field. It has solved
many problems in computer vision, speech recognition, natural language processing, and …