Efficient Neural Networks for Real-time Analog Audio Effect Modeling

02/11/2021
by   Christian J. Steinmetz, et al.
0

Deep learning approaches have demonstrated success in the task of modeling analog audio effects such as distortion and overdrive. Nevertheless, challenges remain in modeling more complex effects, such as dynamic range compressors, along with their variable parameters. Previous methods are computationally complex, and noncausal, prohibiting real-time operation, which is critical for use in audio production contexts. They additionally utilize large training datasets, which are time-intensive to generate. In this work, we demonstrate that shallower temporal convolutional networks (TCNs) that exploit very large dilation factors for significant receptive field can achieve state-of-the-art performance, while remaining efficient. Not only are these models found to be perceptually similar to the original effect, they achieve a 4x speedup, enabling real-time operation on CPU, and can be trained using only 1 data from previous methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/06/2021

Steerable discovery of neural audio effects

Applications of deep learning for audio effects often focus on modeling ...
research
10/08/2020

Randomized Overdrive Neural Networks

By processing audio signals in the time-domain with randomly weighted te...
research
02/03/2022

Removing Distortion Effects in Music Using Deep Neural Networks

Audio effects are an essential element in the context of music productio...
research
05/28/2019

SignalTrain: Profiling Audio Compressors with Deep Neural Networks

In this work we present a data-driven approach for predicting the behavi...
research
09/21/2021

Audiomer: A Convolutional Transformer for Keyword Spotting

Transformers have seen an unprecedented rise in Natural Language Process...
research
11/22/2022

Real-time Neural Radiance Talking Portrait Synthesis via Audio-spatial Decomposition

While dynamic Neural Radiance Fields (NeRF) have shown success in high-f...
research
11/01/2018

Deep Learning for Tube Amplifier Emulation

Analog audio effects and synthesizers often owe their distinct sound to ...

Please sign up or login with your details

Forgot password? Click here to reset