The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Forgetting refers to the loss or deterioration of previously acquired knowledge. While
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …

A survey of machine unlearning

TT Nguyen, TT Huynh, Z Ren, PL Nguyen… - arxiv preprint arxiv …, 2022 - arxiv.org
Today, computer systems hold large amounts of personal data. Yet while such an
abundance of data allows breakthroughs in artificial intelligence, and especially machine …

Rethinking machine unlearning for large language models

S Liu, Y Yao, J Jia, S Casper, N Baracaldo… - arxiv preprint arxiv …, 2024 - arxiv.org
We explore machine unlearning (MU) in the domain of large language models (LLMs),
referred to as LLM unlearning. This initiative aims to eliminate undesirable data influence …

Salun: Empowering machine unlearning via gradient-based weight saliency in both image classification and generation

C Fan, J Liu, Y Zhang, E Wong, D Wei, S Liu - arxiv preprint arxiv …, 2023 - arxiv.org
With evolving data regulations, machine unlearning (MU) has become an important tool for
fostering trust and safety in today's AI models. However, existing MU methods focusing on …

Large language model unlearning

Y Yao, X Xu, Y Liu - arxiv preprint arxiv:2310.10683, 2023 - arxiv.org
We study how to perform unlearning, ie forgetting undesirable (mis) behaviors, on large
language models (LLMs). We show at least three scenarios of aligning LLMs with human …

Fast federated machine unlearning with nonlinear functional theory

T Che, Y Zhou, Z Zhang, L Lyu, J Liu… - International …, 2023 - proceedings.mlr.press
Federated machine unlearning (FMU) aims to remove the influence of a specified subset of
training data upon request from a trained federated learning model. Despite achieving …

To generate or not? safety-driven unlearned diffusion models are still easy to generate unsafe images... for now

Y Zhang, J Jia, X Chen, A Chen, Y Zhang, J Liu… - … on Computer Vision, 2024 - Springer
The recent advances in diffusion models (DMs) have revolutionized the generation of
realistic and complex images. However, these models also introduce potential safety …

Model sparsity can simplify machine unlearning

J Liu, P Ram, Y Yao, G Liu, Y Liu… - Advances in Neural …, 2024 - proceedings.neurips.cc
In response to recent data regulation requirements, machine unlearning (MU) has emerged
as a critical process to remove the influence of specific examples from a given model …

Static and sequential malicious attacks in the context of selective forgetting

C Zhao, W Qian, R Ying, M Huai - Advances in Neural …, 2023 - proceedings.neurips.cc
With the growing demand for the right to be forgotten, there is an increasing need for
machine learning models to forget sensitive data and its impact. To address this, the …