Challenging forgets: Unveiling the worst-case forget sets in machine unlearning

C Fan, J Liu, A Hero, S Liu - European Conference on Computer Vision, 2024 - Springer
The trustworthy machine learning (ML) community is increasingly recognizing the crucial
need for models capable of selectively 'unlearning'data points after training. This leads to the …

Robust mixture-of-expert training for convolutional neural networks

Y Zhang, R Cai, T Chen, G Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has
demonstrated a great promise to enable high-accuracy and ultra-efficient model inference …

Data-and physics-driven deep learning based reconstruction for fast mri: Fundamentals and methodologies

J Huang, Y Wu, F Wang, Y Fang, Y Nan… - IEEE Reviews in …, 2024 - ieeexplore.ieee.org
Magnetic Resonance Imaging (MRI) is a pivotal clinical diagnostic tool, yet its extended
scanning times often compromise patient comfort and image quality, especially in …

Selectivity drives productivity: efficient dataset pruning for enhanced transfer learning

Y Zhang, Y Zhang, A Chen, J Liu… - Advances in …, 2024 - proceedings.neurips.cc
Massive data is often considered essential for deep learning applications, but it also incurs
significant computational and infrastructural costs. Therefore, dataset pruning (DP) has …

Constrained bi-level optimization: Proximal lagrangian value function approach and hessian-free algorithm

W Yao, C Yu, S Zeng, J Zhang - arxiv preprint arxiv:2401.16164, 2024 - arxiv.org
This paper presents a new approach and algorithm for solving a class of constrained Bi-
Level Optimization (BLO) problems in which the lower-level problem involves constraints …

Soul: Unlocking the power of second-order optimization for llm unlearning

J Jia, Y Zhang, Y Zhang, J Liu, B Runwal… - arxiv preprint arxiv …, 2024 - arxiv.org
Large Language Models (LLMs) have highlighted the necessity of effective unlearning
mechanisms to comply with data regulations and ethical AI practices. LLM unlearning aims …

Signal processing and learning for next generation multiple access in 6G

W Chen, Y Liu, H Jafarkhani, YC Eldar… - IEEE Journal of …, 2024 - ieeexplore.ieee.org
Wireless communication systems to date primarily rely on the orthogonality of resources to
facilitate the design and implementation, from user access to data transmission. Emerging …

A multiscale consensus-based algorithm for multi-level optimization

M Herty, Y Huang, D Kalise, H Kouhkouh - arxiv preprint arxiv …, 2024 - arxiv.org
A novel multiscale consensus-based optimization (CBO) algorithm for solving bi-and tri-level
optimization problems is introduced. Existing CBO techniques are generalized by the …

Principled penalty-based methods for bilevel reinforcement learning and rlhf

H Shen, Z Yang, T Chen - arxiv preprint arxiv:2402.06886, 2024 - arxiv.org
Bilevel optimization has been recently applied to many machine learning tasks. However,
their applications have been restricted to the supervised learning setting, where static …

Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy

R Liu, Z Liu, W Yao, S Zeng, J Zhang - arxiv preprint arxiv:2405.09927, 2024 - arxiv.org
This work focuses on addressing two major challenges in the context of large-scale
nonconvex Bi-Level Optimization (BLO) problems, which are increasingly applied in …