Joint Learning of Word and Label Embeddings for Sequence Labelling in Spoken Language Understanding

10/16/2019
by   Jiewen Wu, et al.
0

We propose an architecture to jointly learn word and label embeddings for slot filling in spoken language understanding. The proposed approach encodes labels using a combination of word embeddings and straightforward word-label association from the training data. Compared to the state-of-the-art methods, our approach does not require label embeddings as part of the input and therefore lends itself nicely to a wide range of model architectures. In addition, our architecture computes contextual distances between words and labels to avoid adding contextual windows, thus reducing memory footprint. We validate the approach on established spoken dialogue datasets and show that it can achieve state-of-the-art performance with much fewer trainable parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2019

Learned In Speech Recognition: Contextual Acoustic Word Embeddings

End-to-end acoustic-to-word speech recognition models have recently gain...
research
06/05/2019

Memory Consolidation for Contextual Spoken Language Understanding with Dialogue Logistic Inference

Dialogue contexts are proven helpful in the spoken language understandin...
research
06/24/2016

Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understanding

We investigate the usage of convolutional neural networks (CNNs) for the...
research
06/18/2018

Combining Word Feature Vector Method with the Convolutional Neural Network for Slot Filling in Spoken Language Understanding

Slot filling is an important problem in Spoken Language Understanding (S...
research
04/09/2019

A Hierarchical Decoding Model For Spoken Language Understanding From Unaligned Data

Spoken language understanding (SLU) systems can be trained on two types ...
research
10/13/2016

Exploiting Sentence and Context Representations in Deep Neural Models for Spoken Language Understanding

This paper presents a deep learning architecture for the semantic decode...
research
09/17/2018

Robust Spoken Language Understanding via Paraphrasing

Learning intents and slot labels from user utterances is a fundamental s...

Please sign up or login with your details

Forgot password? Click here to reset