Large-scale ASR Domain Adaptation using Self- and Semi-supervised Learning

10/01/2021
by   Dongseong Hwang, et al.
0

Self- and semi-supervised learning methods have been actively investigated to reduce labeled training data or enhance the model performance. However, the approach mostly focus on in-domain performance for public datasets. In this study, we utilize the combination of self- and semi-supervised learning methods to solve unseen domain adaptation problem in a large-scale production setting for online ASR model. This approach demonstrates that using the source domain data with a small fraction of the target domain data (3 performance gap compared to a full data baseline: relative 13.5 improvement for target domain data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2020

MiCo: Mixup Co-Training for Semi-Supervised Domain Adaptation

Semi-supervised domain adaptation (SSDA) aims to adapt models from a lab...
research
04/25/2020

StRDAN: Synthetic-to-Real Domain Adaptation Network for Vehicle Re-Identification

Vehicle re-identification aims to obtain the same vehicles from vehicle ...
research
04/19/2023

A Comparison of Semi-Supervised Learning Techniques for Streaming ASR at Scale

Unpaired text and audio injection have emerged as dominant methods for i...
research
08/16/2019

Knowledge distillation for semi-supervised domain adaptation

In the absence of sufficient data variation (e.g., scanner and protocol ...
research
09/11/2023

Feature-based Transferable Disruption Prediction for future tokamaks using domain adaptation

The high acquisition cost and the significant demand for disruptive disc...
research
10/18/2022

Enabling Heterogeneous Domain Adaptation in Multi-inhabitants Smart Home Activity Learning

Domain adaptation for sensor-based activity learning is of utmost import...
research
04/27/2021

AT-ST: Self-Training Adaptation Strategy for OCR in Domains with Limited Transcriptions

This paper addresses text recognition for domains with limited manual an...

Please sign up or login with your details

Forgot password? Click here to reset