A comprehensive survey on pretrained foundation models: A history from bert to chatgpt
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …
Knowledge distillation on graphs: A survey
Graph Neural Networks (GNNs) have received significant attention for demonstrating their
capability to handle graph data. However, they are difficult to be deployed in resource …
capability to handle graph data. However, they are difficult to be deployed in resource …
Llmrec: Large language models with graph augmentation for recommendation
The problem of data sparsity has long been a challenge in recommendation systems, and
previous studies have attempted to address this issue by incorporating side information …
previous studies have attempted to address this issue by incorporating side information …
Large language models (LLMs): survey, technical frameworks, and future challenges
P Kumar - Artificial Intelligence Review, 2024 - Springer
Artificial intelligence (AI) has significantly impacted various fields. Large language models
(LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have …
(LLMs) like GPT-4, BARD, PaLM, Megatron-Turing NLG, Jurassic-1 Jumbo etc., have …
Graph neural prompting with large language models
Large language models (LLMs) have shown remarkable generalization capability with
exceptional performance in various language modeling tasks. However, they still exhibit …
exceptional performance in various language modeling tasks. However, they still exhibit …
Higpt: Heterogeneous graph language model
Heterogeneous graph learning aims to capture complex relationships and diverse relational
semantics among entities in a heterogeneous graph to obtain meaningful representations …
semantics among entities in a heterogeneous graph to obtain meaningful representations …
Learning mlps on graphs: A unified view of effectiveness, robustness, and efficiency
While Graph Neural Networks (GNNs) have demonstrated their efficacy in dealing with non-
Euclidean structural data, they are difficult to be deployed in real applications due to the …
Euclidean structural data, they are difficult to be deployed in real applications due to the …
Federated graph learning under domain shift with generalizable prototypes
Federated Graph Learning is a privacy-preserving collaborative approach for training a
shared model on graph-structured data in the distributed environment. However, in real …
shared model on graph-structured data in the distributed environment. However, in real …
Breaking the trilemma of privacy, utility, and efficiency via controllable machine unlearning
Machine Unlearning (MU) algorithms have become increasingly critical due to the
imperative adherence to data privacy regulations. The primary objective of MU is to erase …
imperative adherence to data privacy regulations. The primary objective of MU is to erase …
Fair graph representation learning via diverse mixture-of-experts
Graph Neural Networks (GNNs) have demonstrated a great representation learning
capability on graph data and have been utilized in various downstream applications …
capability on graph data and have been utilized in various downstream applications …