Content Word-based Sentence Decoding and Evaluating for Open-domain Neural Response Generation

05/31/2019
by   Tianyu Zhao, et al.
0

Various encoder-decoder models have been applied to response generation in open-domain dialogs, but a majority of conventional models directly learn a mapping from lexical input to lexical output without explicitly modeling intermediate representations. Utilizing language hierarchy and modeling intermediate information have been shown to benefit many language understanding and generation tasks. Motivated by Broca's aphasia, we propose to use a content word sequence as an intermediate representation for open-domain response generation. Experimental results show that the proposed method improves content relatedness of produced responses, and our models can often choose correct grammar for generated content words. Meanwhile, instead of evaluating complete sentences, we propose to compute conventional metrics on content word sequences, which is a better indicator of content relevance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/13/2021

Text is NOT Enough: Integrating Visual Impressions intoOpen-domain Dialogue Generation

Open-domain dialogue generation in natural language processing (NLP) is ...
research
06/14/2019

Neural Response Generation with Meta-Words

We present open domain response generation with meta-words. A meta-word ...
research
10/10/2020

Cue-word Driven Neural Response Generation with a Shrinking Vocabulary

Open-domain response generation is the task of generating sensible and i...
research
01/09/2017

Neural Personalized Response Generation as Domain Adaptation

In this paper, we focus on the personalized response generation for conv...
research
04/20/2020

Adaptation of a Lexical Organization for Social Engineering Detection and Response Generation

We present a paradigm for extensible lexicon development based on Lexica...
research
01/17/2023

Learning a Formality-Aware Japanese Sentence Representation

While the way intermediate representations are generated in encoder-deco...
research
08/24/2023

MultiPA: a multi-task speech pronunciation assessment system for a closed and open response scenario

The design of automatic speech pronunciation assessment can be categoriz...

Please sign up or login with your details

Forgot password? Click here to reset