Sound2Synth: Interpreting Sound via FM Synthesizer Parameters Estimation

05/06/2022
by   Zui Chen, et al.
8

Synthesizer is a type of electronic musical instrument that is now widely used in modern music production and sound design. Each parameters configuration of a synthesizer produces a unique timbre and can be viewed as a unique instrument. The problem of estimating a set of parameters configuration that best restore a sound timbre is an important yet complicated problem, i.e.: the synthesizer parameters estimation problem. We proposed a multi-modal deep-learning-based pipeline Sound2Synth, together with a network structure Prime-Dilated Convolution (PDC) specially designed to solve this problem. Our method achieved not only SOTA but also the first real-world applicable results on Dexed synthesizer, a popular FM synthesizer.

READ FULL TEXT

page 3

page 4

page 6

page 7

research
03/28/2017

Deep scattering transform applied to note onset detection and instrument recognition

Automatic Music Transcription (AMT) is one of the oldest and most well-s...
research
10/19/2022

Modeling Animal Vocalizations through Synthesizers

Modeling real-world sound is a fundamental problem in the creative use o...
research
10/08/2020

Vrengt: A Shared Body-Machine Instrument for Music-Dance Performance

This paper describes the process of developing a shared instrument for m...
research
06/22/2022

Jointist: Joint Learning for Multi-instrument Transcription and Its Applications

In this paper, we introduce Jointist, an instrument-aware multi-instrume...
research
10/20/2019

Musical Instrument Playing Technique Detection Based on FCN: Using Chinese Bowed-Stringed Instrument as an Example

Unlike melody extraction and other aspects of music transcription, resea...
research
10/04/2020

Resonant Processing of Instrumental Sound Controlled by Spatial Position

We present an acoustic musical instrument played through a resonance mod...
research
05/29/2018

Learning to Transcribe by Ear

Rethinking how to model polyphonic transcription formally, we frame it a...

Please sign up or login with your details

Forgot password? Click here to reset