Generate, Evaluate, and Select: A Dialogue System with a Response Evaluator for Diversity-Aware Response Generation

06/10/2022
by   Ryoma Sakaeda, et al.
0

We aim to overcome the lack of diversity in responses of current dialogue systems and to develop a dialogue system that is engaging as a conversational partner. We propose a generator-evaluator model that evaluates multiple responses generated by a response generator and selects the best response by an evaluator. By generating multiple responses, we obtain diverse responses. We conduct human evaluations to compare the output of the proposed system with that of a baseline system. The results of the human evaluations showed that the proposed system's responses were often judged to be better than the baseline system's, and indicated the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/11/2022

Measuring and Improving Semantic Diversity of Dialogue Generation

Response diversity has become an important criterion for evaluating the ...
research
06/23/2019

DAL: Dual Adversarial Learning for Dialogue Generation

In open-domain dialogue systems, generative approaches have attracted mu...
research
08/07/2020

Diversifying Task-oriented Dialogue Response Generation with Prototype Guided Paraphrasing

Existing methods for Dialogue Response Generation (DRG) in Task-oriented...
research
09/16/2018

Generating Informative and Diverse Conversational Responses via Adversarial Information Maximization

Responses generated by neural conversational models tend to lack informa...
research
09/19/2023

PICK: Polished Informed Candidate Scoring for Knowledge-Grounded Dialogue Systems

Grounding dialogue response generation on external knowledge is proposed...
research
05/06/2020

Weakly-Supervised Neural Response Selection from an Ensemble of Task-Specialised Dialogue Agents

Dialogue engines that incorporate different types of agents to converse ...
research
06/24/2019

Conversational Response Re-ranking Based on Event Causality and Role Factored Tensor Event Embedding

We propose a novel method for selecting coherent and diverse responses f...

Please sign up or login with your details

Forgot password? Click here to reset