A character representation enhanced on-device Intent Classification

01/12/2021
by   Sudeep Deepak Shivnikar, et al.
0

Intent classification is an important task in natural language understanding systems. Existing approaches have achieved perfect scores on the benchmark datasets. However they are not suitable for deployment on low-resource devices like mobiles, tablets, etc. due to their massive model size. Therefore, in this paper, we present a novel light-weight architecture for intent classification that can run efficiently on a device. We use character features to enrich the word representation. Our experiments prove that our proposed model outperforms existing approaches and achieves state-of-the-art results on benchmark datasets. We also report that our model has tiny memory footprint of  5 MB and low inference time of  2 milliseconds, which proves its efficiency in a resource-constrained environment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/03/2021

Intent Recognition and Unsupervised Slot Identification for Low Resourced Spoken Dialog Systems

Intent Recognition and Slot Identification are crucial components in spo...
research
10/18/2021

Intent Classification Using Pre-Trained Embeddings For Low Resource Languages

Building Spoken Language Understanding (SLU) systems that do not rely on...
research
09/02/2017

Grasping the Finer Point: A Supervised Similarity Network for Metaphor Detection

The ubiquity of metaphor in our everyday communication makes it an impor...
research
11/15/2019

Bootstrapping NLU Models with Multi-task Learning

Bootstrapping natural language understanding (NLU) systems with minimal ...
research
06/28/2021

Enhancing the Generalization for Intent Classification and Out-of-Domain Detection in SLU

Intent classification is a major task in spoken language understanding (...
research
10/22/2020

Investigating the True Performance of Transformers in Low-Resource Languages: A Case Study in Automatic Corpus Creation

Transformers represent the state-of-the-art in Natural Language Processi...
research
11/27/2020

Rethinking Generalization in American Sign Language Prediction for Edge Devices with Extremely Low Memory Footprint

Due to the boom in technical compute in the last few years, the world ha...

Please sign up or login with your details

Forgot password? Click here to reset