Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systems

04/08/2021
by   Juan Zuluaga-Gomez, et al.
0

Air traffic management and specifically air-traffic control (ATC) rely mostly on voice communications between Air Traffic Controllers (ATCos) and pilots. In most cases, these voice communications follow a well-defined grammar that could be leveraged in Automatic Speech Recognition (ASR) technologies. The callsign used to address an airplane is an essential part of all ATCo-pilot communications. We propose a two-steps approach to add contextual knowledge during semi-supervised training to reduce the ASR system error rates at recognizing the part of the utterance that contains the callsign. Initially, we represent in a WFST the contextual knowledge (i.e. air-surveillance data) of an ATCo-pilot communication. Then, during Semi-Supervised Learning (SSL) the contextual knowledge is added by second-pass decoding (i.e. lattice re-scoring). Results show that `unseen domains' (e.g. data from airports not present in the supervised training data) are further aided by contextual SSL when compared to standalone SSL. For this task, we introduce the Callsign Word Error Rate (CA-WER) as an evaluation metric, which only assesses ASR performance of the spoken callsign in an utterance. We obtained a 32.1 relative improvement applying SSL with an additional 17.5 by adding contextual knowledge during SSL on a challenging ATC-based test set gathered from LiveATC.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/18/2020

Automatic Speech Recognition Benchmark for Air-Traffic Communications

Advances in Automatic Speech Recognition (ASR) over the last decade open...
research
04/16/2023

A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers

In this paper we propose a novel virtual simulation-pilot engine for spe...
research
04/13/2022

Call-sign recognition and understanding for noisy air-traffic transcripts using surveillance information

Air traffic control (ATC) relies on communication via speech between pil...
research
08/27/2021

Grammar Based Identification Of Speaker Role For Improving ATCO And Pilot ASR

Assistant Based Speech Recognition (ABSR) for air traffic control is gen...
research
08/27/2021

Improving callsign recognition with air-surveillance data in air-traffic communication

Automatic Speech Recognition (ASR) can be used as the assistance of spee...
research
12/14/2022

Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulator

This paper describes a simple yet efficient repetition-based modular sys...
research
02/08/2022

A two-step approach to leverage contextual data: speech recognition in air-traffic communications

Automatic Speech Recognition (ASR), as the assistance of speech communic...

Please sign up or login with your details

Forgot password? Click here to reset