A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
Graph representation learning in biomedicine and healthcare
Networks—or graphs—are universal descriptors of systems of interacting elements. In
biomedicine and healthcare, they can represent, for example, molecular interactions …
biomedicine and healthcare, they can represent, for example, molecular interactions …
Graphmae: Self-supervised masked graph autoencoders
Self-supervised learning (SSL) has been extensively explored in recent years. Particularly,
generative SSL has seen emerging success in natural language processing and other …
generative SSL has seen emerging success in natural language processing and other …
Graph neural networks: foundation, frontiers and applications
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …
recent years. Graph neural networks, also known as deep learning on graphs, graph …
A comprehensive survey on deep graph representation learning
Graph representation learning aims to effectively encode high-dimensional sparse graph-
structured data into low-dimensional dense vectors, which is a fundamental task that has …
structured data into low-dimensional dense vectors, which is a fundamental task that has …
A comprehensive survey on graph anomaly detection with deep learning
Anomalies are rare observations (eg, data records or events) that deviate significantly from
the others in the sample. Over the past few decades, research on anomaly mining has …
the others in the sample. Over the past few decades, research on anomaly mining has …
A survey on deep semi-supervised learning
Deep semi-supervised learning is a fast-growing field with a range of practical applications.
This paper provides a comprehensive survey on both fundamentals and recent advances in …
This paper provides a comprehensive survey on both fundamentals and recent advances in …
Graph self-supervised learning: A survey
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …
works have focused on (semi-) supervised learning, resulting in shortcomings including …
Graphprompt: Unifying pre-training and downstream tasks for graph neural networks
Graphs can model complex relationships between objects, enabling a myriad of Web
applications such as online page/article classification and social recommendation. While …
applications such as online page/article classification and social recommendation. While …
UltraGCN: ultra simplification of graph convolutional networks for recommendation
With the recent success of graph convolutional networks (GCNs), they have been widely
applied for recommendation, and achieved impressive performance gains. The core of …
applied for recommendation, and achieved impressive performance gains. The core of …