Point-based Acoustic Scattering for Interactive Sound Propagation via Surface Encoding

05/17/2021
by   Hsien-Yu Meng, et al.
0

We present a novel geometric deep learning method to compute the acoustic scattering properties of geometric objects. Our learning algorithm uses a point cloud representation of objects to compute the scattering properties and integrates them with ray tracing for interactive sound propagation in dynamic scenes. We use discrete Laplacian-based surface encoders and approximate the neighborhood of each point using a shared multi-layer perceptron. We show that our formulation is permutation invariant and present a neural network that computes the scattering function using spherical harmonics. Our approach can handle objects with arbitrary topologies and deforming models, and takes less than 1ms per object on a commodity GPU. We have analyzed the accuracy and perform validation on thousands of unseen 3D objects and highlight the benefits over other point-based geometric deep learning methods. To the best of our knowledge, this is the first real-time learning algorithm that can approximate the acoustic scattering properties of arbitrary objects with high accuracy.

READ FULL TEXT

page 6

page 10

page 11

page 12

research
10/10/2020

Learning Acoustic Scattering Fields for Dynamic Interactive Sound Propagation

We present a novel hybrid sound propagation algorithm for interactive ap...
research
06/03/2023

BEDRF: Bidirectional Edge Diffraction Response Function for Interactive Sound Propagation

We introduce bidirectional edge diffraction response function (BEDRF), a...
research
08/17/2021

DeepEigen: Learning-based Modal Sound Synthesis with Acoustic Transfer Maps

We present a novel learning-based approach to compute the eigenmodes and...
research
03/01/2018

Interactive Sound Rendering on Mobile Devices using Ray-Parameterized Reverberation Filters

We present a new sound rendering pipeline that is able to generate plaus...
research
05/18/2022

MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenes

We propose a mesh-based neural network (MESH2IR) to generate acoustic im...
research
10/21/2020

Prediction of Object Geometry from Acoustic Scattering Using Convolutional Neural Networks

Acoustic scattering is strongly influenced by boundary geometry of objec...
research
10/18/2019

Classification of spherical objects based on the form function of acoustic echoes

One way to recognise an object is to study how the echo has been shaped ...

Please sign up or login with your details

Forgot password? Click here to reset