Interactive Sound Rendering on Mobile Devices using Ray-Parameterized Reverberation Filters

03/01/2018
by   Carl Schissler, et al.
0

We present a new sound rendering pipeline that is able to generate plausible sound propagation effects for interactive dynamic scenes. Our approach combines ray-tracing-based sound propagation with reverberation filters using robust automatic reverb parameter estimation that is driven by impulse responses computed at a low sampling rate.We propose a unified spherical harmonic representation of directional sound in both the propagation and auralization modules and use this formulation to perform a constant number of convolution operations for any number of sound sources while rendering spatial audio. In comparison to previous geometric acoustic methods, we achieve a speedup of over an order of magnitude while delivering similar audio to high-quality convolution rendering algorithms. As a result, our approach is the first capable of rendering plausible dynamic sound propagation effects on commodity smartphones.

READ FULL TEXT

page 1

page 12

page 16

research
10/10/2020

Learning Acoustic Scattering Fields for Dynamic Interactive Sound Propagation

We present a novel hybrid sound propagation algorithm for interactive ap...
research
02/02/2023

Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes

We present an end-to-end binaural audio rendering approach (Listen2Scene...
research
06/03/2023

BEDRF: Bidirectional Edge Diffraction Response Function for Interactive Sound Propagation

We introduce bidirectional edge diffraction response function (BEDRF), a...
research
01/08/2020

A rasterized ray-tracer pipeline for real-time, multi-device sonar simulation

Simulating sonar devices requires modeling complex underwater acoustics,...
research
02/09/2022

Binaural Audio Rendering in the Spherical Harmonic Domain: A Summary of the Mathematics and its Pitfalls

The present document reviews the mathematics behind binaural rendering o...
research
07/24/2021

Dynamic Portal Occlusion for Precomputed Interactive Sound Propagation

An immersive audio-visual experience in games and virtual reality requir...
research
05/17/2021

Point-based Acoustic Scattering for Interactive Sound Propagation via Surface Encoding

We present a novel geometric deep learning method to compute the acousti...

Please sign up or login with your details

Forgot password? Click here to reset