Dynamic Portal Occlusion for Precomputed Interactive Sound Propagation

07/24/2021
by   Nikunj Raghuvanshi, et al.
0

An immersive audio-visual experience in games and virtual reality requires fast calculation of diffraction-based acoustic effects. To maintain plausibility, the effects must retain spatial smoothness on source and listener motion within geometrically complex scenes. Precomputed wave-based techniques can render such results at low runtime CPU cost, but remain limited to static scenes. Modeling the occlusion effect of dynamic portals such as doors present an unresolved challenge to maintain audio-visual consistency. We present a fast solution implementable as a drop-in extension to existing precomputed systems. Key is a novel portal-search method that leverages precomputed propagation delay and direction data to find portals intervening the diffracted shortest path connecting dynamic source and listener at runtime. The method scales linearly with number of portals in worst case, far cheaper than explicit global path search that scales with scene area. We discuss culling techniques to accelerate further. The search algorithm is combined with geometric-acoustic approximations to model the additional direct and indirect energy loss from intervening portals depending on their dynamic closure state. We demonstrate plausible audio-visual animations within our system integrated with Unreal Engine 4 (TM) and AudioKinetic Wwise (TM).

READ FULL TEXT

page 2

page 5

research
10/10/2020

Learning Acoustic Scattering Fields for Dynamic Interactive Sound Propagation

We present a novel hybrid sound propagation algorithm for interactive ap...
research
02/02/2023

Listen2Scene: Interactive material-aware binaural sound propagation for reconstructed 3D scenes

We present an end-to-end binaural audio rendering approach (Listen2Scene...
research
03/01/2018

Interactive Sound Rendering on Mobile Devices using Ray-Parameterized Reverberation Filters

We present a new sound rendering pipeline that is able to generate plaus...
research
09/26/2021

Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

Interactive audio spatialization technology previously developed for vid...
research
08/09/2023

Sound propagation in realistic interactive 3D scenes with parameterized sources using deep neural operators

We address the challenge of sound propagation simulations in 3D virtual ...
research
05/18/2022

MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenes

We propose a mesh-based neural network (MESH2IR) to generate acoustic im...

Please sign up or login with your details

Forgot password? Click here to reset