Sound Synthesis, Propagation, and Rendering: A Survey

11/11/2020
by   Shiguang Liu, et al.
0

Sound, as a crucial sensory channel, plays a vital role in improving the reality and immersiveness of a virtual environment, following only vision in importance. Sound can provide important clues such as sound directionality and spatial size. This paper gives a broad overview of research works on sound simulation in virtual reality, games, multimedia, computer-aided design. We first survey various sound synthesis methods, including harmonic synthesis, texture synthesis, spectral analysis, and physics-based synthesis. Then, we summarize popular sound propagation techniques, namely wave-based methods, geometric-based methods, and hybrid methods. Next, the sound rendering methods are reviewed. We further demonstrate the latest deep learning based sound simulation approaches. Finally, we point to some future directions of this field. To the best of our knowledge, this is the first attempt to provide a comprehensive summary of sound research in the field of computer graphics.

READ FULL TEXT

page 3

page 4

page 5

page 7

page 8

page 9

page 15

page 16

research
05/21/2023

El Sonido como Elemento Clave en Prácticas de Realidad Virtual

This article discusses the importance of sound for virtual reality syste...
research
10/01/2022

NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review

Neural Radiance Field (NeRF), a new novel view synthesis with implicit s...
research
04/25/2023

Foley Sound Synthesis at the DCASE 2023 Challenge

The addition of Foley sound effects during post-production is a common t...
research
09/19/2019

On the Impact of Ground Sound

Rigid-body impact sound synthesis methods often omit the ground sound. I...
research
02/19/2019

P-Reverb: Perceptual Characterization of Early and Late Reflections for Auditory Displays

We introduce a novel, perceptually derived metric (P-Reverb) that relate...
research
06/29/2017

Toward Inverse Control of Physics-Based Sound Synthesis

Long Short-Term Memory networks (LSTMs) can be trained to realize invers...
research
04/17/2023

Unleashing the Power of Sound: Revisiting the Physics of Notations for Modelling with auditory symbols

Sound - the oft-neglected sense for Software Engineering - is a crucial ...

Please sign up or login with your details

Forgot password? Click here to reset