Vers la compréhension automatique de la parole bout-en-bout à moindre effort

07/01/2022
by   Marco Naguib, et al.
0

Recent advances in spoken language understanding benefited from Self-Supervised models trained on large speech corpora. For French, the LeBenchmark project has made such models available and has led to impressive progress on several tasks including spoken language understanding. These advances have a non-negligible cost in terms of computation time and energy consumption. In this paper, we compare several learning strategies aiming at reducing such cost while keeping competitive performances. The experiments are performed on the MEDIA corpus, and show that it is possible to reduce the learning cost while maintaining state-of-the-art performances.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/01/2022

Toward Low-Cost End-to-End Spoken Language Understanding

Recent advances in spoken language understanding benefited from Self-Sup...
research
07/19/2022

Benchmarking Transformers-based models on French Spoken Language Understanding tasks

In the last five years, the rise of the self-attentional Transformer-bas...
research
07/03/2023

Semantic enrichment towards efficient speech representations

Over the past few years, self-supervised learned speech representations ...
research
06/14/2023

SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?

Self-supervised learning (SSL) for speech representation has been succes...
research
09/30/2020

End-to-End Spoken Language Understanding Without Full Transcripts

An essential component of spoken language understanding (SLU) is slot fi...
research
04/20/2019

Energy-based Self-attentive Learning of Abstractive Communities for Spoken Language Understanding

Abstractive Community Detection is an important Spoken Language Understa...
research
09/07/2018

Data Augmentation for Spoken Language Understanding via Joint Variational Generation

Data scarcity is one of the main obstacles of domain adaptation in spoke...

Please sign up or login with your details

Forgot password? Click here to reset