Neural Style Transfer for Audio Spectograms

01/04/2018
by   Prateek Verma, et al.
0

There has been fascinating work on creating artistic transformations of images by Gatys. This was revolutionary in how we can in some sense alter the 'style' of an image while generally preserving its 'content'. In our work, we present a method for creating new sounds using a similar approach, treating it as a style-transfer problem, starting from a random-noise input signal and iteratively using back-propagation to optimize the sound to conform to filter-outputs from a pre-trained neural architecture of interest. For demonstration, we investigate two different tasks, resulting in bandwidth expansion/compression, and timbral transfer from singing voice to musical instruments. A feature of our method is that a single architecture can generate these different audio-style-transfer types using the same set of parameters which otherwise require different complex hand-tuned diverse signal processing pipelines.

READ FULL TEXT
research
10/31/2017

Audio style transfer

"Style transfer" among images has recently emerged as a very active rese...
research
11/22/2018

TimbreTron: A WaveNet(CycleGAN(CQT(Audio))) Pipeline for Musical Timbre Transfer

In this work, we address the problem of musical timbre transfer, where t...
research
11/29/2017

Time Domain Neural Audio Style Transfer

A recently published method for audio style transfer has shown how to ex...
research
12/18/2018

Autoencoder Based Architecture For Fast & Real Time Audio Style Transfer

Recently, there has been great interest in the field of audio style tran...
research
03/17/2023

Style Transfer for 2D Talking Head Animation

Audio-driven talking head animation is a challenging research topic with...
research
02/10/2021

Self-Supervised VQ-VAE For One-Shot Music Style Transfer

Neural style transfer, allowing to apply the artistic style of one image...
research
10/19/2020

MicAugment: One-shot Microphone Style Transfer

A crucial aspect for the successful deployment of audio-based models "in...

Please sign up or login with your details

Forgot password? Click here to reset