A review of differentiable digital signal processing for music and speech synthesis

B Hayes, J Shier, G Fazekas, A McPherson… - Frontiers in Signal …, 2024 - frontiersin.org
The term “differentiable digital signal processing” describes a family of techniques in which
loss function gradients are backpropagated through digital signal processors, facilitating …

Style transfer of audio effects with differentiable signal processing

CJ Steinmetz, NJ Bryan, JD Reiss - arxiv preprint arxiv:2207.08759, 2022 - arxiv.org
We present a framework that can impose the audio effects and production style from one
recording to another by example with the goal of simplifying the audio production process …

Differentiable wavetable synthesis

S Shan, L Hantrakul, J Chen, M Avent… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
Differentiable Wavetable Synthesis (DWTS) is a technique for neural audio synthesis which
learns a dictionary of one-period waveforms ie wavetables, through end-to-end training. We …

Deep adaptive AEC: Hybrid of deep learning and adaptive acoustic echo cancellation

H Zhang, S Kandadai, H Rao, M Kim… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
In this paper we integrate classic adaptive filtering algorithms with modern deep learning to
propose a new approach called deep adaptive AEC. The main idea is to represent the linear …

DDSP-based singing vocoders: A new subtractive-based synthesizer and a comprehensive evaluation

DY Wu, WY Hsiao, FR Yang, O Friedman… - arxiv preprint arxiv …, 2022 - arxiv.org
A vocoder is a conditional audio generation model that converts acoustic features such as
mel-spectrograms into waveforms. Taking inspiration from Differentiable Digital Signal …

Improving semi-supervised differentiable synthesizer sound matching for practical applications

N Masuda, D Saito - IEEE/ACM Transactions on Audio, Speech …, 2023 - ieeexplore.ieee.org
While synthesizers have become commonplace in music production, many users find it
difficult to control the parameters of a synthesizer to create a sound as they intended. In …

Music mixing style transfer: A contrastive learning approach to disentangle audio effects

J Koo, MA Martínez-Ramírez, WH Liao… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
We propose an end-to-end music mixing style transfer system that converts the mixing style
of an input multitrack to that of a reference song. This is achieved with an encoder pre …

[PDF][PDF] Synthesizer Sound Matching with Differentiable DSP.

N Masuda, D Saito - ISMIR, 2021 - archives.ismir.net
While synthesizers have become commonplace in music production, many users find it
difficult to control the parameters of a synthesizer to create the intended sound. In order to …

DiffMoog: a differentiable modular synthesizer for sound matching

N Uzrad, O Barkan, A Elharar, S Shvartzman… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper presents DiffMoog-a differentiable modular synthesizer with a comprehensive set
of modules typically found in commercial instruments. Being differentiable, it allows …

Model-Based Deep Learning for Music Information Research: Leveraging diverse knowledge sources to enhance explainability, controllability, and resource efficiency …

G Richard, V Lostanlen, YH Yang… - IEEE Signal Processing …, 2025 - ieeexplore.ieee.org
In this article, we investigate the notion of model-based deep learning in the realm of music
information research (MIR). Loosely speaking, we refer to the term model-based deep …