An Attentional Neural Conversation Model with Improved Specificity

06/03/2016
by   Kaisheng Yao, et al.
0

In this paper we propose a neural conversation model for conducting dialogues. We demonstrate the use of this model to generate help desk responses, where users are asking questions about PC applications. Our model is distinguished by two characteristics. First, it models intention across turns with a recurrent network, and incorporates an attention model that is conditioned on the representation of intention. Secondly, it avoids generating non-specific responses by incorporating an IDF term in the objective function. The model is evaluated both as a pure generation model in which a help-desk response is generated from scratch, and as a retrieval model with performance measured using recall rates of the correct response. Experimental results indicate that the model outperforms previously proposed neural conversation architectures, and that using specificity in the objective function significantly improves performances for both generation and retrieval.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2015

A Diversity-Promoting Objective Function for Neural Conversation Models

Sequence-to-sequence neural network models for generation of conversatio...
research
10/29/2015

Attention with Intention for a Neural Network Conversation Model

In a conversation or a dialogue process, attention and intention play in...
research
06/07/2019

Building a Production Model for Retrieval-Based Chatbots

Response suggestion is an important task for building human-computer con...
research
05/23/2018

Self-Attention-Based Message-Relevant Response Generation for Neural Conversation Model

Using a sequence-to-sequence framework, many neural conversation models ...
research
03/09/2015

Neural Responding Machine for Short-Text Conversation

We propose Neural Responding Machine (NRM), a neural network-based respo...
research
07/24/2019

Fine-Grained Sentence Functions for Short-Text Conversation

Sentence function is an important linguistic feature referring to a user...
research
03/30/2021

Put Chatbot into Its Interlocutor's Shoes: New Framework to Learn Chatbot Responding with Intention

Most chatbot literature that focuses on improving the fluency and cohere...

Please sign up or login with your details

Forgot password? Click here to reset