Predicting Global Head-Related Transfer Functions From Scanned Head Geometry Using Deep Learning and Compact Representations

07/28/2022
by   Yuxiang Wang, et al.
0

In the growing field of virtual auditory display, personalized head-related transfer functions (HRTFs) play a vital role in establishing an accurate sound image. In this work, we propose an HRTF personalization method employing convolutional neural networks (CNN) to predict a subject's HRTFs for all directions from their scanned head geometry. To ease the training of the CNN models, we propose novel pre-processing methods for both the head scans and HRTF data to achieve compact representations. For the head scan, we use truncated spherical cap harmonic (SCH) coefficients to represent the pinna area, which is important in the acoustic scattering process. For the HRTF data, we use truncated spherical harmonic (SH) coefficients to represent the HRTF magnitudes and onsets. One CNN model is trained to predict the SH coefficients of the HRTF magnitudes from the SCH coefficients of the scanned ear geometry and other anthropometric measurements of the head. The other CNN model is trained to predict SH coefficients of the HRTF onsets from only the anthropometric measurements of the ear, head, and torso. Combining the magnitude and onset predictions, our method is able to predict the complete and global HRTF data. A leave-one-out validation with the log-spectral distortion (LSD) metric is used for objective evaluation. The results show a decent LSD level at both spatial & temporal dimensions compared to the ground-truth HRTFs and a lower LSD than the boundary element method (BEM) simulation of HRTFs that the database provides. The localization simulation results with an auditory model are also consistent with the objective evaluation metrics, showing the localization responses with our predicted HRTFs are significantly better than with the BEM calculated ones.

READ FULL TEXT

page 1

page 4

page 6

page 10

research
09/15/2023

Head-Related Transfer Function Interpolation with a Spherical CNN

Head-related transfer functions (HRTFs) are crucial for spatial soundfie...
research
09/12/2022

Continuous head-related transfer function representation based on hyperspherical harmonics

Expressing head-related transfer functions (HRTFs) in spherical harmonic...
research
09/29/2021

Objective-oriented method for uniformation of various directivity representations

Over recent years, numerous attempts were taken to provide efficient met...
research
03/21/2022

Individualizing Head-Related Transfer Functions for Binaural Acoustic Applications

A Head Related Transfer Function (HRTF) characterizes how a human ear re...
research
07/18/2023

Efficient representation of head-related transfer functions in continuous space-frequency domains

Utilizing spherical harmonic (SH) domain has been established as the def...
research
05/28/2020

On time-domain NRBC for Maxwell's equations and its application in accurate simulation of electromagnetic invisibility cloaks

In this paper, we present analytic formulas of the temporal convolution ...
research
03/07/2022

HRTF measurement for accurate identification of binaural sound localization cues

Although various research institutes have measured head-related transfer...

Please sign up or login with your details

Forgot password? Click here to reset