Regression-based music emotion prediction using triplet neural networks

01/25/2020
by   Kin Wai Cheuk, et al.
0

In this paper, we adapt triplet neural networks (TNNs) to a regression task, music emotion prediction. Since TNNs were initially introduced for classification, and not for regression, we propose a mechanism that allows them to provide meaningful low dimensional representations for regression tasks. We then use these new representations as the input for regression algorithms such as support vector machines and gradient boosting machines. To demonstrate the TNNs' effectiveness at creating meaningful representations, we compare them to different dimensionality reduction methods on music emotion prediction, i.e., predicting valence and arousal values from musical audio signals. Our results on the DEAM dataset show that by using TNNs we achieve 90 dimensionality reduction with a 9 improvement in arousal prediction with respect to our baseline models (without TNN). Our TNN method outperforms other dimensionality reduction methods such as principal component analysis (PCA) and autoencoders (AE). This shows that, in addition to providing a compact latent space representation of audio features, the proposed approach has a relatively high performance over the baseline models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/11/2018

Autoencoders for music sound synthesis: a comparison of linear, shallow, deep and variational models

This study investigates the use of non-linear unsupervised dimensionalit...
research
01/31/2016

Dimensionality Reduction via Regression in Hyperspectral Imagery

This paper introduces a new unsupervised method for dimensionality reduc...
research
11/10/2016

Policy Search with High-Dimensional Context Variables

Direct contextual policy search methods learn to improve policy paramete...
research
04/14/2021

Unsupervised low-rank representations for speech emotion recognition

We examine the use of linear and non-linear dimensionality reduction alg...
research
05/23/2022

PCA-Boosted Autoencoders for Nonlinear Dimensionality Reduction in Low Data Regimes

Autoencoders (AE) provide a useful method for nonlinear dimensionality r...
research
03/01/2020

Dimensionality reduction to maximize prediction generalization capability

This work develops an analytically solvable unsupervised learning scheme...
research
12/09/2020

Spatial noise-aware temperature retrieval from infrared sounder data

In this paper we present a combined strategy for the retrieval of atmosp...

Please sign up or login with your details

Forgot password? Click here to reset