TensorFlow Audio Models in Essentia

03/16/2020
by   Pablo Alonso-Jiménez, et al.
0

Essentia is a reference open-source C++/Python library for audio and music analysis. In this work, we present a set of algorithms that employ TensorFlow in Essentia, allow predictions with pre-trained deep learning models, and are designed to offer flexibility of use, easy extensibility, and real-time inference. To show the potential of this new interface with TensorFlow, we provide a number of pre-trained state-of-the-art music tagging and classification CNN models. We run an extensive evaluation of the developed models. In particular, we assess the generalization capabilities in a cross-collection evaluation utilizing both external tag datasets as well as manual annotations tailored to the taxonomies of our models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/14/2019

musicnn: Pre-trained convolutional neural networks for music audio tagging

Pronounced as "musician", the musicnn library contains a set of pre-trai...
research
09/15/2023

MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response

Large Language Models (LLMs) have shown immense potential in multimodal ...
research
07/12/2021

Codified audio language modeling learns useful representations for music information retrieval

We demonstrate that language models pre-trained on codified (discretely-...
research
06/01/2020

Evaluation of CNN-based Automatic Music Tagging Models

Recent advances in deep learning accelerated the development of content-...
research
06/22/2020

Graph Neural Networks in TensorFlow and Keras with Spektral

In this paper we present Spektral, an open-source Python library for bui...
research
03/04/2020

ASMD: an automatic framework for compiling multimodal datasets with audio and scores

This paper describes an open-source Python framework for handling datase...
research
11/03/2021

Automatic Embedding of Stories Into Collections of Independent Media

We look at how machine learning techniques that derive properties of ite...

Please sign up or login with your details

Forgot password? Click here to reset