Towards Controllable Audio Texture Morphing

04/23/2023
by   Chitralekha Gupta, et al.
0

In this paper, we propose a data-driven approach to train a Generative Adversarial Network (GAN) conditioned on "soft-labels" distilled from the penultimate layer of an audio classifier trained on a target set of audio texture classes. We demonstrate that interpolation between such conditions or control vectors provides smooth morphing between the generated audio textures, and shows similar or better audio texture morphing capability compared to the state-of-the-art methods. The proposed approach results in a well-organized latent space that generates novel audio outputs while remaining consistent with the semantics of the conditioning parameters. This is a step towards a general data-driven approach to designing generative audio models with customized controls capable of traversing out-of-distribution regions for novel sound synthesis.

READ FULL TEXT
research
06/27/2022

Sound Model Factory: An Integrated System Architecture for Generative Audio Modelling

We introduce a new system for data-driven audio sound model design built...
research
08/23/2023

Example-Based Framework for Perceptually Guided Audio Texture Generation

Generative models for synthesizing audio textures explicitly encode cont...
research
11/15/2019

Generative Audio Synthesis with a Parametric Model

Use a parametric representation of audio to train a generative model in ...
research
03/01/2023

READ Avatars: Realistic Emotion-controllable Audio Driven Avatars

We present READ Avatars, a 3D-based approach for generating 2D avatars t...
research
01/11/2019

Texture Mixer: A Network for Controllable Synthesis and Interpolation of Texture

This paper addresses the problem of interpolating visual textures. We fo...
research
11/25/2020

MTCRNN: A multi-scale RNN for directed audio texture synthesis

Audio textures are a subset of environmental sounds, often defined as ha...
research
04/06/2022

Global HRTF Interpolation via Learned Affine Transformation of Hyper-conditioned Features

Estimating Head-Related Transfer Functions (HRTFs) of arbitrary source p...

Please sign up or login with your details

Forgot password? Click here to reset