Challenging forgets: Unveiling the worst-case forget sets in machine unlearning
The trustworthy machine learning (ML) community is increasingly recognizing the crucial
need for models capable of selectively 'unlearning'data points after training. This leads to the …
need for models capable of selectively 'unlearning'data points after training. This leads to the …
Robust mixture-of-expert training for convolutional neural networks
Abstract Sparsely-gated Mixture of Expert (MoE), an emerging deep model architecture, has
demonstrated a great promise to enable high-accuracy and ultra-efficient model inference …
demonstrated a great promise to enable high-accuracy and ultra-efficient model inference …
Data-and physics-driven deep learning based reconstruction for fast mri: Fundamentals and methodologies
Magnetic Resonance Imaging (MRI) is a pivotal clinical diagnostic tool, yet its extended
scanning times often compromise patient comfort and image quality, especially in …
scanning times often compromise patient comfort and image quality, especially in …
Selectivity drives productivity: efficient dataset pruning for enhanced transfer learning
Massive data is often considered essential for deep learning applications, but it also incurs
significant computational and infrastructural costs. Therefore, dataset pruning (DP) has …
significant computational and infrastructural costs. Therefore, dataset pruning (DP) has …
Constrained bi-level optimization: Proximal lagrangian value function approach and hessian-free algorithm
This paper presents a new approach and algorithm for solving a class of constrained Bi-
Level Optimization (BLO) problems in which the lower-level problem involves constraints …
Level Optimization (BLO) problems in which the lower-level problem involves constraints …
Soul: Unlocking the power of second-order optimization for llm unlearning
Large Language Models (LLMs) have highlighted the necessity of effective unlearning
mechanisms to comply with data regulations and ethical AI practices. LLM unlearning aims …
mechanisms to comply with data regulations and ethical AI practices. LLM unlearning aims …
Signal processing and learning for next generation multiple access in 6G
Wireless communication systems to date primarily rely on the orthogonality of resources to
facilitate the design and implementation, from user access to data transmission. Emerging …
facilitate the design and implementation, from user access to data transmission. Emerging …
A multiscale consensus-based algorithm for multi-level optimization
A novel multiscale consensus-based optimization (CBO) algorithm for solving bi-and tri-level
optimization problems is introduced. Existing CBO techniques are generalized by the …
optimization problems is introduced. Existing CBO techniques are generalized by the …
Principled penalty-based methods for bilevel reinforcement learning and rlhf
Bilevel optimization has been recently applied to many machine learning tasks. However,
their applications have been restricted to the supervised learning setting, where static …
their applications have been restricted to the supervised learning setting, where static …
Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy
This work focuses on addressing two major challenges in the context of large-scale
nonconvex Bi-Level Optimization (BLO) problems, which are increasingly applied in …
nonconvex Bi-Level Optimization (BLO) problems, which are increasingly applied in …