Differentially private natural language models: Recent advances and future directions
Recent developments in deep learning have led to great success in various natural
language processing (NLP) tasks. However, these applications may involve data that …
language processing (NLP) tasks. However, these applications may involve data that …
Prompt-saw: Leveraging relation-aware graphs for textual prompt compression
Large Language Models (LLMs) have shown exceptional abilities for multiple different
natural language processing tasks. While prompting is a crucial tool for LLM inference, we …
natural language processing tasks. While prompting is a crucial tool for LLM inference, we …
Leveraging logical rules in knowledge editing: A cherry on the top
Multi-hop Question Answering (MQA) under knowledge editing (KE) is a key challenge in
Large Language Models (LLMs). While best-performing solutions in this domain use a plan …
Large Language Models (LLMs). While best-performing solutions in this domain use a plan …
Advancing differential privacy: Where we are now and future directions for real-world deployment
In this article, we present a detailed review of current practices and state-of-the-art
methodologies in the field of differential privacy (DP), with a focus of advancing DP's …
methodologies in the field of differential privacy (DP), with a focus of advancing DP's …
Multi-hop question answering under temporal knowledge editing
Multi-hop question answering (MQA) under knowledge editing (KE) has garnered significant
attention in the era of large language models. However, existing models for MQA under KE …
attention in the era of large language models. However, existing models for MQA under KE …
Dialectical alignment: Resolving the tension of 3h and security threats of llms
With the rise of large language models (LLMs), ensuring they embody the principles of being
helpful, honest, and harmless (3H), known as Human Alignment, becomes crucial. While …
helpful, honest, and harmless (3H), known as Human Alignment, becomes crucial. While …
Private Language Models via Truncated Laplacian Mechanism
Deep learning models for NLP tasks are prone to variants of privacy attacks. To prevent
privacy leakage, researchers have investigated word-level perturbations, relying on the …
privacy leakage, researchers have investigated word-level perturbations, relying on the …
Generalized Eigenvalue Problems with Generative Priors
Generalized eigenvalue problems (GEPs) find applications in various fields of science and
engineering. For example, principal component analysis, Fisher's discriminant analysis, and …
engineering. For example, principal component analysis, Fisher's discriminant analysis, and …
Differentially Private Sliced Inverse Regression: Minimax Optimality and Algorithm
Privacy preservation has become a critical concern in high-dimensional data analysis due to
the growing prevalence of data-driven applications. Proposed by Li (1991), sliced inverse …
the growing prevalence of data-driven applications. Proposed by Li (1991), sliced inverse …