Foley Sound Synthesis at the DCASE 2023 Challenge

04/25/2023
by   Keunwoo Choi, et al.
0

The addition of Foley sound effects during post-production is a common technique used to enhance the perceived acoustic properties of multimedia content. Traditionally, Foley sound has been produced by human Foley artists, which involves manual recording and mixing of sound. However, recent advances in sound synthesis and generative models have generated interest in machine-assisted or automatic Foley synthesis techniques. To promote further research in this area, we have organized a challenge in DCASE 2023: Task 7 - Foley Sound Synthesis. Our challenge aims to provide a standardized evaluation framework that is both rigorous and efficient, allowing for the evaluation of different Foley synthesis systems. Through this challenge, we hope to encourage active participation from the research community and advance the state-of-the-art in automatic Foley synthesis. In this technical report, we provide a detailed overview of the Foley sound synthesis challenge, including task definition, dataset, baseline, evaluation scheme and criteria, and discussion.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/21/2022

A Proposal for Foley Sound Synthesis Challenge

"Foley" refers to sound effects that are added to multimedia during post...
research
08/27/2019

Overview of Tasks and Investigation of Subjective Evaluation Methods in Environmental Sound Synthesis and Conversion

Synthesizing and converting environmental sounds have the potential for ...
research
04/17/2022

Advances in Thunder Sound Synthesis

A recent comparative study evaluated all known thunder synthesis techniq...
research
11/11/2020

Sound Synthesis, Propagation, and Rendering: A Survey

Sound, as a crucial sensory channel, plays a vital role in improving the...
research
06/10/2020

Deep generative models for musical audio synthesis

Sound modelling is the process of developing algorithms that generate so...
research
06/08/2023

VIFS: An End-to-End Variational Inference for Foley Sound Synthesis

The goal of DCASE 2023 Challenge Task 7 is to generate various sound cli...
research
07/15/2021

Sketching sounds: an exploratory study on sound-shape associations

Sound synthesiser controls typically correspond to technical parameters ...

Please sign up or login with your details

Forgot password? Click here to reset