A Generative Model for Natural Sounds Based on Latent Force Modelling

02/02/2018
by   William J. Wilkinson, et al.
0

Recent advances in analysis of subband amplitude envelopes of natural sounds have resulted in convincing synthesis, showing subband amplitudes to be a crucial component of perception. Probabilistic latent variable analysis is particularly revealing, but existing approaches don't incorporate prior knowledge about the physical behaviour of amplitude envelopes, such as exponential decay and feedback. We use latent force modelling, a probabilistic learning paradigm that incorporates physical knowledge into Gaussian process regression, to model correlation across spectral subband envelopes. We augment the standard latent force model approach by explicitly modelling correlations over multiple time steps. Incorporating this prior knowledge strengthens the interpretation of the latent functions as the source that generated the signal. We examine this interpretation via an experiment which shows that sounds generated by sampling from our probabilistic model are perceived to be more realistic than those generated by similar models based on nonnegative matrix factorisation, even in cases where our model is outperformed from a reconstruction error perspective.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2018

Unifying Probabilistic Models for Time-Frequency Analysis

In audio signal processing, probabilistic time-frequency models have man...
research
02/10/2018

Probabilistic Canonical Correlation Analysis: A Whitening Approach

Canonical correlation analysis (CCA) is a classic and widely used statis...
research
05/17/2017

Learning a Hierarchical Latent-Variable Model of 3D Shapes

We propose the Variational Shape Learner (VSL), a hierarchical latent-va...
research
11/01/2018

Multiplicative Latent Force Models

Bayesian modelling of dynamic systems must achieve a compromise between ...
research
10/23/2022

PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variable

Emotional support conversation (ESC) task can utilize various support st...
research
02/14/2012

Sequential Inference for Latent Force Models

Latent force models (LFMs) are hybrid models combining mechanistic princ...

Please sign up or login with your details

Forgot password? Click here to reset