A2D: Anywhere Anytime Drumming

04/04/2023
by   Harel Yadid, et al.
0

The drum kit, which has only been around for around 100 years, is a popular instrument in many music genres such as pop, rock, and jazz. However, the road to owning a kit is expensive, both financially and space-wise. Also, drums are more difficult to move around compared to other instruments, as they do not fit into a single bag. We propose a no-drums approach that uses only two sticks and a smartphone or a webcam to provide an air-drumming experience. The detection algorithm combines deep learning tools with tracking methods for an enhanced user experience. Based on both quantitative and qualitative testing with humans-in-the-loop, we show that our system has zero misses for beginner level play and negligible misses for advanced level play. Additionally, our limited human trials suggest potential directions for future research.

READ FULL TEXT

page 2

page 3

research
02/16/2023

Mixing Levels – A Rock Music Spirit Level App

To date, sonification apps are rare. Music apps on the other hand are wi...
research
11/03/2018

Multitask learning for frame-level instrument recognition

For many music analysis problems, we need to know the presence of instru...
research
06/01/2021

Omnizart: A General Toolbox for Automatic Music Transcription

We present and release Omnizart, a new Python library that provides a st...
research
03/28/2023

Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approach

This paper presents our work to enhance the background music (BGM) in Da...
research
07/13/2021

Timbre Classification of Musical Instruments with a Deep Learning Multi-Head Attention-Based Model

The aim of this work is to define a model based on deep learning that is...
research
02/27/2019

Accelerating Self-Play Learning in Go

By introducing several new Go-specific and non-Go-specific techniques al...
research
08/04/2023

Avatar Fusion Karaoke: Research and development on multi-user music play VR experience in the metaverse

This paper contributes to building a standard process of research and de...

Please sign up or login with your details

Forgot password? Click here to reset