DeepAI AI Chat
Log In Sign Up

Neural Drum Machine : An Interactive System for Real-time Synthesis of Drum Sounds

07/04/2019
by   Cyran Aouameur, et al.
IRCAM
Sony
0

In this work, we introduce a system for real-time generation of drum sounds. This system is composed of two parts: a generative model for drum sounds together with a Max4Live plugin providing intuitive controls on the generative process. The generative model consists of a Conditional Wasserstein autoencoder (CWAE), which learns to generate Mel-scaled magnitude spectrograms of short percussion samples, coupled with a Multi-Head Convolutional Neural Network (MCNN) which estimates the corresponding audio signal from the magnitude spectrogram. The design of this model makes it lightweight, so that it allows one to perform real-time generation of novel drum sounds on an average CPU, removing the need for the users to possess dedicated hardware in order to use this system. We then present our Max4Live interface designed to interact with this generative model. With this setup, the system can be easily integrated into a studio-production environment and enhance the creative process. Finally, we discuss the advantages of our system and how the interaction of music producers with such tools could change the way drum tracks are composed.

READ FULL TEXT

page 2

page 6

page 7

05/15/2022

cMelGAN: An Efficient Conditional Generative Model Based on Mel Spectrograms

Analysing music in the field of machine learning is a very difficult pro...
07/23/2019

NONOTO: A Model-agnostic Web Interface for Interactive Music Composition by Inpainting

Inpainting-based generative modeling allows for stimulating human-machin...
07/19/2021

Early-Phase Performance-Driven Design using Generative Models

Current performance-driven building design methods are not widely adopte...
09/03/2019

Lund jet images from generative and cycle-consistent adversarial networks

We introduce a generative model to simulate radiation patterns within a ...
08/18/2022

Musika! Fast Infinite Waveform Music Generation

Fast and user-controllable music generation could enable novel ways of c...
04/06/2019

An Integrated Approach for Keyphrase Generation via Exploring the Power of Retrieval and Extraction

In this paper, we present a novel integrated approach for keyphrase gene...