A review of differentiable digital signal processing for music and speech synthesis

B Hayes, J Shier, G Fazekas, A McPherson… - Frontiers in Signal …, 2024 - frontiersin.org
The term “differentiable digital signal processing” describes a family of techniques in which
loss function gradients are backpropagated through digital signal processors, facilitating …

A history of audio effects

T Wilmering, D Moffat, A Milo, MB Sandler - Applied Sciences, 2020 - mdpi.com
Audio effects are an essential tool that the field of music production relies upon. The ability to
intentionally manipulate and modify a piece of sound has opened up considerable …

The internet of sounds: Convergent trends, insights, and future directions

L Turchet, M Lagrange, C Rottondi… - IEEE Internet of …, 2023 - ieeexplore.ieee.org
Current sound-based practices and systems developed in both academia and industry point
to convergent research trends that bring together the field of sound and music Computing …

Style transfer of audio effects with differentiable signal processing

CJ Steinmetz, NJ Bryan, JD Reiss - arxiv preprint arxiv:2207.08759, 2022 - arxiv.org
We present a framework that can impose the audio effects and production style from one
recording to another by example with the goal of simplifying the audio production process …

Automatic multitrack mixing with a differentiable mixing console of neural audio effects

CJ Steinmetz, J Pons, S Pascual… - ICASSP 2021-2021 …, 2021 - ieeexplore.ieee.org
Applications of deep learning to automatic multitrack mixing are largely unexplored. This is
partly due to the limited available data, coupled with the fact that such data is relatively …

Differentiable signal processing with black-box audio effects

MAM Ramírez, O Wang, P Smaragdis… - ICASSP 2021-2021 …, 2021 - ieeexplore.ieee.org
We present a data-driven approach to automate audio signal processing by incorporating
stateful third-party, audio effects as layers within a deep neural network. We then train a …

Automatic music mixing with deep learning and out-of-domain data

MA Martínez-Ramírez, WH Liao, G Fabbro… - arxiv preprint arxiv …, 2022 - arxiv.org
Music mixing traditionally involves recording instruments in the form of clean, individual
tracks and blending them into a final mixture using audio effects and expert knowledge (eg …

Music mixing style transfer: A contrastive learning approach to disentangle audio effects

J Koo, MA Martínez-Ramírez, WH Liao… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
We propose an end-to-end music mixing style transfer system that converts the mixing style
of an input multitrack to that of a reference song. This is achieved with an encoder pre …

A deep learning approach to intelligent drum mixing with the wave-u-net

M Martinez Ramirez, D Stoller, D Moffat - 2021 - pearl.plymouth.ac.uk
The development of intelligent music production tools has been of growing interest in recent
years. Deep learning approaches have been shown as being a highly effective method for …

AI Music Mixing Systems

D Moffat - Handbook of Artificial Intelligence for Music …, 2021 - Springer
Mixing music, or music production, is the process of combining a series of different musical
tracks together, while applying a range of audio processing to blend the tracks together in a …