Source-Critical Reinforcement Learning for Transferring Spoken Language Understanding to a New Language

08/19/2018
by   He Bai, et al.
0

To deploy a spoken language understanding (SLU) model to a new language, language transferring is desired to avoid the trouble of acquiring and labeling a new big SLU corpus. Translating the original SLU corpus into the target language is an attractive strategy. However, SLU corpora consist of plenty of semantic labels (slots), which general-purpose translators cannot handle well, not to mention additional culture differences. This paper focuses on the language transferring task given a tiny in-domain parallel SLU corpus. The in-domain parallel corpus can be used as the first adaptation on the general translator. But more importantly, we show how to use reinforcement learning (RL) to further finetune the adapted translator, where translated sentences with more proper slot tags receive higher rewards. We evaluate our approach on Chinese to English language transferring for SLU systems. The experimental results show that the generated English SLU corpus via adaptation and reinforcement learning gives us over 97 accuracy in domain classification. It demonstrates the effectiveness of the proposed language transferring method. Compared with naive translation, our proposed method improves domain classification accuracy by relatively 22 the slot filling F1 score by relatively more than 71

READ FULL TEXT
research
07/25/2021

A Joint and Domain-Adaptive Approach to Spoken Language Understanding

Spoken Language Understanding (SLU) is composed of two subtasks: intent ...
research
06/24/2016

Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understanding

We investigate the usage of convolutional neural networks (CNNs) for the...
research
10/29/2022

End-to-end Spoken Language Understanding with Tree-constrained Pointer Generator

End-to-end spoken language understanding (SLU) suffers from the long-tai...
research
11/30/2017

Multi-Domain Adversarial Learning for Slot Filling in Spoken Language Understanding

The goal of this paper is to learn cross-domain representations for slot...
research
08/24/2022

PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling

Most existing slot filling models tend to memorize inherent patterns of ...
research
04/18/2017

A Broad-Coverage Challenge Corpus for Sentence Understanding through Inference

This paper introduces the Multi-Genre Natural Language Inference (MultiN...

Please sign up or login with your details

Forgot password? Click here to reset