HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields

10/27/2022
by   You Zhang, et al.
0

Head-related transfer functions (HRTFs) are a set of functions describing the spatial filtering effect of the outer ear (i.e., torso, head, and pinnae) onto sound sources at different azimuth and elevation angles. They are widely used in spatial audio rendering. While the azimuth and elevation angles are intrinsically continuous, measured HRTFs in existing datasets employ different spatial sampling schemes, making it difficult to model HRTFs across datasets. In this work, we propose to use neural fields, a differentiable representation of functions through neural networks, to model HRTFs with arbitrary spatial sampling schemes. Such representation is unified across datasets with different spatial sampling schemes. HRTFs for arbitrary azimuth and elevation angles can be derived from this representation. We further introduce a generative model named HRTF field to learn the latent space of the HRTF neural fields across subjects. We demonstrate promising performance on HRTF interpolation and generation tasks and point out potential future work.

READ FULL TEXT

page 1

page 4

research
07/11/2023

SAR-NeRF: Neural Radiance Fields for Synthetic Aperture Radar Multi-View Representation

SAR images are highly sensitive to observation configurations, and they ...
research
05/21/2023

VL-Fields: Towards Language-Grounded Neural Implicit Spatial Representations

We present Visual-Language Fields (VL-Fields), a neural implicit spatial...
research
03/17/2023

Magnitude-Corrected and Time-Aligned Interpolation of Head-Related Transfer Functions

Head-related transfer functions (HRTFs) are essential for virtual acoust...
research
01/19/2022

Semantic-Aware Implicit Neural Audio-Driven Video Portrait Generation

Animating high-fidelity video portrait with speech audio is crucial for ...
research
04/06/2022

Global HRTF Interpolation via Learned Affine Transformation of Hyper-conditioned Features

Estimating Head-Related Transfer Functions (HRTFs) of arbitrary source p...
research
10/20/2022

Model-matching Principle Applied to the Design of an Array-based All-neural Binaural Rendering System for Audio Telepresence

Telepresence aims to create an immersive but virtual experience of the f...
research
05/08/2023

Neural Steerer: Novel Steering Vector Synthesis with a Causal Neural Field over Frequency and Source Positions

Neural fields have successfully been used in many research fields for th...

Please sign up or login with your details

Forgot password? Click here to reset