How to dp-fy ml: A practical guide to machine learning with differential privacy

N Ponomareva, H Hazimeh, A Kurakin, Z Xu… - Journal of Artificial …, 2023 - jair.org
Abstract Machine Learning (ML) models are ubiquitous in real-world applications and are a
constant focus of research. Modern ML models have become more complex, deeper, and …

A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges

W Li, R Huang, J Li, Y Liao, Z Chen, G He… - … Systems and Signal …, 2022 - Elsevier
Abstract Deep Transfer Learning (DTL) is a new paradigm of machine learning, which can
not only leverage the advantages of Deep Learning (DL) in feature representation, but also …

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

G Team, P Georgiev, VI Lei, R Burnell, L Bai… - arxiv preprint arxiv …, 2024 - arxiv.org
In this report, we introduce the Gemini 1.5 family of models, representing the next generation
of highly compute-efficient multimodal models capable of recalling and reasoning over fine …

Symbolic discovery of optimization algorithms

X Chen, C Liang, D Huang, E Real… - Advances in neural …, 2023 - proceedings.neurips.cc
We present a method to formulate algorithm discovery as program search, and apply it to
discover optimization algorithms for deep neural network training. We leverage efficient …

Transformers learn to implement preconditioned gradient descent for in-context learning

K Ahn, X Cheng, H Daneshmand… - Advances in Neural …, 2023 - proceedings.neurips.cc
Several recent works demonstrate that transformers can implement algorithms like gradient
descent. By a careful construction of weights, these works show that multiple layers of …

Diffusion-lm improves controllable text generation

X Li, J Thickstun, I Gulrajani… - Advances in Neural …, 2022 - proceedings.neurips.cc
Controlling the behavior of language models (LMs) without re-training is a major open
problem in natural language generation. While recent works have demonstrated successes …

Protein design with guided discrete diffusion

N Gruver, S Stanton, N Frey… - Advances in neural …, 2023 - proceedings.neurips.cc
A popular approach to protein design is to combine a generative model with a discriminative
model for conditional sampling. The generative model samples plausible sequences while …

Quantum optimization of maximum independent set using Rydberg atom arrays

S Ebadi, A Keesling, M Cain, TT Wang, H Levine… - Science, 2022 - science.org
Realizing quantum speedup for practically relevant, computationally hard problems is a
central challenge in quantum information science. Using Rydberg atom arrays with up to …

New tools for automated cryo-EM single-particle analysis in RELION-4.0

D Kimanius, L Dong, G Sharov, T Nakane… - Biochemical …, 2021 - portlandpress.com
We describe new tools for the processing of electron cryo-microscopy (cryo-EM) images in
the fourth major release of the RELION software. In particular, we introduce VDAM, a …

Federated learning on non-IID data: A survey

H Zhu, J Xu, S Liu, Y ** - Neurocomputing, 2021 - Elsevier
Federated learning is an emerging distributed machine learning framework for privacy
preservation. However, models trained in federated learning usually have worse …