Training Strategies for Own Voice Reconstruction in Hearing Protection Devices using an In-ear Microphone

05/12/2022
by   Mattes Ohlenbusch, et al.
0

In-ear microphones in hearing protection devices can be utilized to capture the own voice speech of the person wearing the devices in noisy environments. Since in-ear recordings of the own voice are typically band-limited, an own voice reconstruction system is required to recover clean broadband speech from the in-ear signals. However, the availability of speech data for this scenario is typically limited due to device-specific transfer characteristics and the need to collect data from in-situ measurements. In this paper, we apply a deep learning-based bandwidth-extension system to the own voice reconstruction task and investigate different training strategies in order to overcome the limited availability of training data. Experimental results indicate that the use of simulated training data based on recordings of several talkers in combination with a fine-tuning approach using real data is advantageous compared to directly training on a small real dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2023

Speech-dependent Modeling of Own Voice Transfer Characteristics for In-ear Microphones in Hearables

Many hearables contain an in-ear microphone, which may be used to captur...
research
05/09/2023

VSMask: Defending Against Voice Synthesis Attack via Real-Time Predictive Perturbation

Deep learning based voice synthesis technology generates artificial huma...
research
03/21/2023

Personalized Lightweight Text-to-Speech: Voice Cloning with Adaptive Structured Pruning

Personalized TTS is an exciting and highly desired application that allo...
research
06/25/2021

Evaluation of Deep-Learning-Based Voice Activity Detectors and Room Impulse Response Models in Reverberant Environments

State-of-the-art deep-learning-based voice activity detectors (VADs) are...
research
04/06/2019

ReMASC: Realistic Replay Attack Corpus for Voice Controlled Systems

This paper introduces a new database of voice recordings with the goal o...
research
04/17/2019

Understanding the Effectiveness of Ultrasonic Microphone Jammer

Recent works have explained the principle of using ultrasonic transmissi...
research
05/17/2019

The Audio Auditor: Participant-Level Membership Inference in Voice-Based IoT

Voice interfaces and assistants implemented by various services have bec...

Please sign up or login with your details

Forgot password? Click here to reset