How to dp-fy ml: A practical guide to machine learning with differential privacy
Abstract Machine Learning (ML) models are ubiquitous in real-world applications and are a
constant focus of research. Modern ML models have become more complex, deeper, and …
constant focus of research. Modern ML models have become more complex, deeper, and …
A perspective survey on deep transfer learning for fault diagnosis in industrial scenarios: Theories, applications and challenges
Abstract Deep Transfer Learning (DTL) is a new paradigm of machine learning, which can
not only leverage the advantages of Deep Learning (DL) in feature representation, but also …
not only leverage the advantages of Deep Learning (DL) in feature representation, but also …
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
G Team, P Georgiev, VI Lei, R Burnell, L Bai… - arxiv preprint arxiv …, 2024 - arxiv.org
In this report, we introduce the Gemini 1.5 family of models, representing the next generation
of highly compute-efficient multimodal models capable of recalling and reasoning over fine …
of highly compute-efficient multimodal models capable of recalling and reasoning over fine …
Symbolic discovery of optimization algorithms
We present a method to formulate algorithm discovery as program search, and apply it to
discover optimization algorithms for deep neural network training. We leverage efficient …
discover optimization algorithms for deep neural network training. We leverage efficient …
Transformers learn to implement preconditioned gradient descent for in-context learning
Several recent works demonstrate that transformers can implement algorithms like gradient
descent. By a careful construction of weights, these works show that multiple layers of …
descent. By a careful construction of weights, these works show that multiple layers of …
Diffusion-lm improves controllable text generation
Controlling the behavior of language models (LMs) without re-training is a major open
problem in natural language generation. While recent works have demonstrated successes …
problem in natural language generation. While recent works have demonstrated successes …
Protein design with guided discrete diffusion
A popular approach to protein design is to combine a generative model with a discriminative
model for conditional sampling. The generative model samples plausible sequences while …
model for conditional sampling. The generative model samples plausible sequences while …
Quantum optimization of maximum independent set using Rydberg atom arrays
Realizing quantum speedup for practically relevant, computationally hard problems is a
central challenge in quantum information science. Using Rydberg atom arrays with up to …
central challenge in quantum information science. Using Rydberg atom arrays with up to …
New tools for automated cryo-EM single-particle analysis in RELION-4.0
We describe new tools for the processing of electron cryo-microscopy (cryo-EM) images in
the fourth major release of the RELION software. In particular, we introduce VDAM, a …
the fourth major release of the RELION software. In particular, we introduce VDAM, a …