Evaluating Cross-Lingual Transfer Learning Approaches in Multilingual Conversational Agent Models

12/07/2020
by   Lizhen Tan, et al.
0

With the recent explosion in popularity of voice assistant devices, there is a growing interest in making them available to user populations in additional countries and languages. However, to provide the highest accuracy and best performance for specific user populations, most existing voice assistant models are developed individually for each region or language, which requires linear investment of effort. In this paper, we propose a general multilingual model framework for Natural Language Understanding (NLU) models, which can help bootstrap new language models faster and reduce the amount of effort required to develop each language separately. We explore how different deep learning architectures affect multilingual NLU model performance. Our experimental results show that these multilingual models can reach same or better performance compared to monolingual models across language-specific test data while require less effort in creating features and model maintenance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2018

XNLI: Evaluating Cross-lingual Sentence Representations

State-of-the-art natural language processing systems rely on supervision...
research
04/18/2017

Baselines and test data for cross-lingual inference

Research in natural language inference is currently exclusive to English...
research
06/02/2020

WikiBERT models: deep transfer learning for many languages

Deep neural language models such as BERT have enabled substantial recent...
research
05/24/2023

Boosting Cross-lingual Transferability in Multilingual Models via In-Context Learning

Existing cross-lingual transfer (CLT) prompting methods are only concern...
research
05/17/2019

Adaptation of Deep Bidirectional Multilingual Transformers for Russian Language

The paper introduces methods of adaptation of multilingual masked langua...
research
12/13/2022

The Massively Multilingual Natural Language Understanding 2022 (MMNLU-22) Workshop and Competition

Despite recent progress in Natural Language Understanding (NLU), the cre...

Please sign up or login with your details

Forgot password? Click here to reset