DeepAI AI Chat
Log In Sign Up

Synthesizer Preset Interpolation using Transformer Auto-Encoders

10/27/2022
by   Gwendal Le Vaillant, et al.
0

Sound synthesizers are widespread in modern music production but they increasingly require expert skills to be mastered. This work focuses on interpolation between presets, i.e., sets of values of all sound synthesis parameters, to enable the intuitive creation of new sounds from existing ones. We introduce a bimodal auto-encoder neural network, which simultaneously processes presets using multi-head attention blocks, and audio using convolutions. This model has been tested on a popular frequency modulation synthesizer with more than one hundred parameters. Experiments have compared the model to related architectures and methods, and have demonstrated that it performs smoother interpolations. After training, the proposed model can be integrated into commercial synthesizers for live interpolation or sound design tasks.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/03/2023

A geometrically aware auto-encoder for multi-texture synthesis

We propose an auto-encoder architecture for multi-texture synthesis. The...
08/04/2020

Timbre latent space: exploration and creative aspects

Recent studies show the ability of unsupervised models to learn invertib...
05/13/2022

Multi-encoder Network for Parameter Reduction of a Kernel-based Interpolation Architecture

Video frame interpolation involves the synthesis of new frames from exis...
08/04/2020

Neural Granular Sound Synthesis

Granular sound synthesis is a popular audio generation technique based o...
07/01/2019

Universal audio synthesizer control with normalizing flows

The ubiquity of sound synthesizers has reshaped music production and eve...
05/06/2022

Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation

Synthesizer is a type of electronic musical instrument that is now widel...
12/15/2018

Deep Synthesizer Parameter Estimation

Sound synthesis is a complex field that requires domain expertise. Manua...