Combining Word Feature Vector Method with the Convolutional Neural Network for Slot Filling in Spoken Language Understanding

06/18/2018
by   Ruixi Lin, et al.
0

Slot filling is an important problem in Spoken Language Understanding (SLU) and Natural Language Processing (NLP), which involves identifying a user's intent and assigning a semantic concept to each word in a sentence. This paper presents a word feature vector method and combines it into the convolutional neural network (CNN). We consider 18 word features and each word feature is constructed by merging similar word labels. By introducing the concept of external library, we propose a feature set approach that is beneficial for building the relationship between a word from the training dataset and the feature. Computational results are reported using the ATIS dataset and comparisons with traditional CNN as well as bi-directional sequential CNN are also presented.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/24/2016

Sequential Convolutional Neural Networks for Slot Filling in Spoken Language Understanding

We investigate the usage of convolutional neural networks (CNNs) for the...
research
05/15/2018

Marrying up Regular Expressions with Neural Networks: A Case Study for Spoken Language Understanding

The success of many natural language processing (NLP) tasks is bound by ...
research
10/13/2016

Exploiting Sentence and Context Representations in Deep Neural Models for Spoken Language Understanding

This paper presents a deep learning architecture for the semantic decode...
research
01/15/2017

Neural Models for Sequence Chunking

Many natural language understanding (NLU) tasks, such as shallow parsing...
research
10/16/2019

Joint Learning of Word and Label Embeddings for Sequence Labelling in Spoken Language Understanding

We propose an architecture to jointly learn word and label embeddings fo...
research
10/15/2019

VFNet: A Convolutional Architecture for Accent Classification

Understanding accent is an issue which can derail any human-machine inte...
research
08/24/2022

PSSAT: A Perturbed Semantic Structure Awareness Transferring Method for Perturbation-Robust Slot Filling

Most existing slot filling models tend to memorize inherent patterns of ...

Please sign up or login with your details

Forgot password? Click here to reset