Dual Quaternion Ambisonics Array for Six-Degree-of-Freedom Acoustic Representation

04/04/2022
by   Eleonora Grassucci, et al.
7

Spatial audio methods are gaining a growing interest due to the spread of immersive audio experiences and applications, such as virtual and augmented reality. For these purposes, 3D audio signals are often acquired through arrays of Ambisonics microphones, each comprising four capsules that decompose the sound field in spherical harmonics. In this paper, we propose a dual quaternion representation of the spatial sound field acquired through an array of two First Order Ambisonics (FOA) microphones. The audio signals are encapsulated in a dual quaternion that leverages quaternion algebra properties to exploit correlations among them. This augmented representation with 6 degrees of freedom (6DOF) involves a more accurate coverage of the sound field, resulting in a more precise sound localization and a more immersive audio experience. We evaluate our approach on a sound event localization and detection (SELD) benchmark. We show that our dual quaternion SELD model with temporal convolution blocks (DualQSELD-TCN) achieves better results with respect to real and quaternion-valued baselines thanks to our augmented representation of the sound field. Full code is available at: https://github.com/ispamm/DualQSELD-TCN.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/15/2023

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

While direction of arrival (DOA) of sound events is generally estimated ...
research
02/13/2022

Visual Sound Localization in the Wild by Cross-Modal Interference Erasing

The task of audio-visual sound source localization has been well studied...
research
03/22/2023

Dual-Quaternions: Theory and Applications in Sound

Sound is a fundamental and rich source of information; playing a key rol...
research
11/08/2021

The complex-valued correlation coefficient accounts for binaural detection

Binaural hearing is one of the principal mechanisms enabling the localiz...
research
06/14/2021

Multiple scattering ambisonics: three-dimensional sound foeld estimation using interacting spheres

Rigid spherical microphone arrays (RSMAs) have been widely used in ambis...
research
10/08/2021

A Method for Capturing and Reproducing Directional Reverberation in Six Degrees of Freedom

The reproduction of acoustics is an important aspect of the preservation...
research
04/24/2020

Binaural Audio Source Remixing with Microphone Array Listening Devices

Augmented listening devices, such as hearing aids and augmented reality ...

Please sign up or login with your details

Forgot password? Click here to reset