Attention with Intention for a Neural Network Conversation Model

10/29/2015
by   Kaisheng Yao, et al.
0

In a conversation or a dialogue process, attention and intention play intrinsic roles. This paper proposes a neural network based approach that models the attention and intention processes. It essentially consists of three recurrent networks. The encoder network is a word-level model representing source side sentences. The intention network is a recurrent network that models the dynamics of the intention process. The decoder network is a recurrent network produces responses to the input from the source side. It is a language model that is dependent on the intention and has an attention mechanism to attend to particular source side words, when predicting a symbol in the response. The model is trained end-to-end without labeling data. Experiments show that this model generates natural responses to user inputs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2016

An Attentional Neural Conversation Model with Improved Specificity

In this paper we propose a neural conversation model for conducting dial...
research
10/11/2022

Bil-DOS: A Bi-lingual Dialogue Ordering System (for Subway)

Due to the unfamiliarity to particular words(or proper nouns) for ingred...
research
03/30/2021

Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention

Most chatbot literature that focuses on improving the fluency and cohere...
research
03/14/2023

X-ReCoSa: Multi-Scale Context Aggregation For Multi-Turn Dialogue Generation

In multi-turn dialogue generation, responses are not only related to the...
research
10/20/2017

Anticipating Daily Intention using On-Wrist Motion Triggered Sensing

Anticipating human intention by observing one's actions has many applica...
research
03/09/2015

Neural Responding Machine for Short-Text Conversation

We propose Neural Responding Machine (NRM), a neural network-based respo...
research
08/05/2015

Listen, Attend and Spell

We present Listen, Attend and Spell (LAS), a neural network that learns ...

Please sign up or login with your details

Forgot password? Click here to reset