A review of differentiable digital signal processing for music and speech synthesis

B Hayes, J Shier, G Fazekas, A McPherson… - Frontiers in Signal …, 2024 - frontiersin.org
The term “differentiable digital signal processing” describes a family of techniques in which
loss function gradients are backpropagated through digital signal processors, facilitating …

Style transfer of audio effects with differentiable signal processing

CJ Steinmetz, NJ Bryan, JD Reiss - arxiv preprint arxiv:2207.08759, 2022 - arxiv.org
We present a framework that can impose the audio effects and production style from one
recording to another by example with the goal of simplifying the audio production process …

DDSP-based singing vocoders: A new subtractive-based synthesizer and a comprehensive evaluation

DY Wu, WY Hsiao, FR Yang, O Friedman… - arxiv preprint arxiv …, 2022 - arxiv.org
A vocoder is a conditional audio generation model that converts acoustic features such as
mel-spectrograms into waveforms. Taking inspiration from Differentiable Digital Signal …

Nrtsi: Non-recurrent time series imputation

S Shan, Y Li, JB Oliva - ICASSP 2023-2023 IEEE International …, 2023 - ieeexplore.ieee.org
Time series imputation is a fundamental task in understanding sequential data. Existing
methods either rely on recurrent models that suffer heavily from error compounding or fail to …

Improving semi-supervised differentiable synthesizer sound matching for practical applications

N Masuda, D Saito - IEEE/ACM Transactions on Audio, Speech …, 2023 - ieeexplore.ieee.org
While synthesizers have become commonplace in music production, many users find it
difficult to control the parameters of a synthesizer to create a sound as they intended. In …

Differentiable piano model for MIDI-to-audio performance synthesis

L Renault, R Mignot, A Roebel - 25th International Conference on …, 2022 - hal.science
Recent neural-based synthesis models have achieved impressive results for musical
instrument sound generation. In particular, the Differentiable Digital Signal Processing …

NoiseBandNet: Controllable time-varying neural synthesis of sound effects using filterbanks

A Barahona-Ríos, T Collins - IEEE/ACM Transactions on Audio …, 2024 - ieeexplore.ieee.org
Controllable neural audio synthesis of sound effects is a challenging task due to the
potential scarcity and spectro-temporal variance of the data. Differentiable digital signal …

GANStrument: Adversarial instrument sound synthesis with pitch-invariant instance conditioning

G Narita, J Shimizu, T Akama - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
We propose GANStrument, a generative adversarial model for instrument sound synthesis.
Given a one-shot sound as input, it is able to generate pitched instrument sounds that reflect …

DiffMoog: a differentiable modular synthesizer for sound matching

N Uzrad, O Barkan, A Elharar, S Shvartzman… - arxiv preprint arxiv …, 2024 - arxiv.org
This paper presents DiffMoog-a differentiable modular synthesizer with a comprehensive set
of modules typically found in commercial instruments. Being differentiable, it allows …

[Књига][B] Explainable Artificial Intelligence: First World Conference, xAI 2023, Lisbon, Portugal, July 26–28, 2023, Proceedings, Part II

L Longo - 2023 - books.google.com
Chapters “Finding Spurious Correlations with Function-Semantic Contrast Analysis” and
“Explaining Socio-Demographic and Behavioral Patterns of Vaccination Against the Swine …