A deep learning approach for understanding natural language commands for mobile service robots

07/09/2018
by   Pedro Henrique Martins, et al.
0

Using natural language to give instructions to robots is challenging, since natural language understanding is still largely an open problem. In this paper we address this problem by restricting our attention to commands modeled as one action, plus arguments (also known as slots). For action detection (also called intent detection) and slot filling various architectures of Recurrent Neural Networks and Long Short Term Memory (LSTM) networks were evaluated, having LSTMs achieved a superior accuracy. As the action requested may not fall within the robots capabilities, a Support Vector Machine(SVM) is used to determine whether it is or not. For the input of the neural networks, several word embedding algorithms were compared. Finally, to implement the system in a robot, a ROS package is created using a SMACH state machine. The proposed system is then evaluated both using well-known datasets and benchmarks in the context of domestic service robots.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/21/2022

Spoken Language Understanding for Conversational AI: Recent Advances and Future Direction

When a human communicates with a machine using natural language on the w...
research
01/07/2016

Leveraging Sentence-level Information with Encoder LSTM for Semantic Slot Filling

Recurrent Neural Network (RNN) and one of its specific architectures, Lo...
research
11/13/2018

A Multi-layer LSTM-based Approach for Robot Command Interaction Modeling

As the first robotic platforms slowly approach our everyday life, we can...
research
07/16/2017

Do Neural Nets Learn Statistical Laws behind Natural Language?

The performance of deep learning in natural language processing has been...
research
06/09/2019

Happy Together: Learning and Understanding Appraisal From Natural Language

In this paper, we explore various approaches for learning two types of a...
research
09/28/2017

Jointly Trained Sequential Labeling and Classification by Sparse Attention Neural Networks

Sentence-level classification and sequential labeling are two fundamenta...

Please sign up or login with your details

Forgot password? Click here to reset