Do not look back: an online beat tracking method using RNN and enhanced particle filtering

11/05/2020
by   Mojtaba Heydari, et al.
0

Online beat tracking (OBT) has always been a challenging task. Due to the inaccessibility of future data and the need to make inference in real-time. We propose Do not Look back! (DLB), a novel approach optimized for efficiency when performing OBT. DLB feeds the activations of a unidirectional RNN into an enhanced Monte-Carlo localization model to infer beat positions. Most preexisting OBT methods either apply some offline approaches to a moving window containing past data to make predictions about future beat positions or must be primed with past data at startup to initialize. Meanwhile, our proposed method only uses activation of the current time frame to infer beat positions. As such, without waiting at the beginning to receive a chunk, it provides an immediate beat tracking response, which is critical for many OBT applications. DLB significantly improves beat tracking accuracy over state-of-the-art OBT methods, yielding a similar performance to offline methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/08/2021

BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking

The online estimation of rhythmic information, such as beat positions, d...
research
01/19/2023

Benchmarking YOLOv5 and YOLOv7 models with DeepSORT for droplet tracking applications

Tracking droplets in microfluidics is a challenging task. The difficulty...
research
12/04/2018

Intensity Particle Flow SMC-PHD Filter For Audio Speaker Tracking

Non-zero diffusion particle flow Sequential Monte Carlo probability hypo...
research
04/16/2021

Temporally smooth online action detection using cycle-consistent future anticipation

Many video understanding tasks work in the offline setting by assuming t...
research
09/10/2020

Orientation Keypoints for 6D Human Pose Estimation

Most realtime human pose estimation approaches are based on detecting jo...
research
03/18/2021

Higher Performance Visual Tracking with Dual-Modal Localization

Visual Object Tracking (VOT) has synchronous needs for both robustness a...

Please sign up or login with your details

Forgot password? Click here to reset