Individualizing Head-Related Transfer Functions for Binaural Acoustic Applications

03/21/2022
by   Navid H. Zandi, et al.
0

A Head Related Transfer Function (HRTF) characterizes how a human ear receives sounds from a point in space, and depends on the shapes of one's head, pinna, and torso. Accurate estimations of HRTFs for human subjects are crucial in enabling binaural acoustic applications such as sound localization and 3D sound spatialization. Unfortunately, conventional approaches for HRTF estimation rely on specialized devices or lengthy measurement processes. This work proposes a novel lightweight method for HRTF individualization that can be implemented using commercial-off-the-shelf components and performed by average users in home settings. The proposed method has two key components: a generative neural network model that can be individualized to predict HRTFs of new subjects from sparse measurements, and a lightweight measurement procedure that collects HRTF data from spatial locations. Extensive experiments using a public dataset and in house measurement data from 10 subjects of different ages and genders, show that the individualized models significantly outperform a baseline model in the accuracy of predicted HRTFs. To further demonstrate the advantages of individualized HRTFs, we implement two prototype applications for binaural localization and acoustic spatialization. We find that the performance of a localization model is improved by 15 degree after trained with individualized HRTFs. Furthermore, in hearing tests, the success rate of correctly identifying the azimuth direction of incoming sounds increases by 183

READ FULL TEXT
research
03/07/2022

HRTF measurement for accurate identification of binaural sound localization cues

Although various research institutes have measured head-related transfer...
research
06/09/2020

C-SL: Contrastive Sound Localization with Inertial-Acoustic Sensors

Human brain employs perceptual information about the head and eye moveme...
research
07/28/2022

Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations

In the growing field of virtual auditory display, personalized head-rela...
research
09/15/2023

Head-Related Transfer Function Interpolation with a Spherical CNN

Head-related transfer functions (HRTFs) are crucial for spatial soundfie...
research
10/07/2021

Towards Faster Continuous Multi-Channel HRTF Measurements Based on Learning System Models

Measuring personal head-related transfer functions (HRTFs) is essential ...
research
09/21/2022

Modeling Perceptual Loudness of Piano Tone: Theory and Applications

The relationship between perceptual loudness and physical attributes of ...
research
04/15/2019

Saliency Prediction on Omnidirectional Images with Generative Adversarial Imitation Learning

When watching omnidirectional images (ODIs), subjects can access differe...

Please sign up or login with your details

Forgot password? Click here to reset