Importance of a Search Strategy in Neural Dialogue Modelling

11/02/2018
by   Ilya Kulikov, et al.
0

Search strategies for generating a response from a neural dialogue model have received relatively little attention compared to improving network architectures and learning algorithms in recent years. In this paper, we consider a standard neural dialogue model based on recurrent networks with an attention mechanism, and focus on evaluating the impact of the search strategy. We compare four search strategies: greedy search, beam search, iterative beam search and iterative beam search followed by selection scoring. We evaluate these strategies using human evaluation of full conversations and compare them using automatic metrics including log-probabilities, scores and diversity metrics. We observe a significant gap between greedy search and the proposed iterative beam search augmented with selection scoring, demonstrating the importance of the search algorithm in neural dialogue generation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/12/2020

Iterative beam search algorithms for the permutation flowshop

We study an iterative beam search algorithm for the permutation flowshop...
research
05/12/2016

Noisy Parallel Approximate Decoding for Conditional Recurrent Language Model

Recent advances in conditional recurrent language modelling have mainly ...
research
09/11/2021

Looking for Confirmations: An Effective and Human-Like Visual Dialogue Strategy

Generating goal-oriented questions in Visual Dialogue tasks is a challen...
research
06/01/2019

Multi-Turn Beam Search for Neural Dialogue Modeling

In neural dialogue modeling, a neural network is trained to predict the ...
research
04/23/2020

gBeam-ACO: a greedy and faster variant of Beam-ACO

Beam-ACO, a modification of the traditional Ant Colony Optimization (ACO...
research
03/17/2020

Learning to Accelerate Decomposition for Multi-Directional 3D Printing

Multi-directional 3D printing has the capability of decreasing or elimin...
research
10/07/2016

Diverse Beam Search: Decoding Diverse Solutions from Neural Sequence Models

Neural sequence models are widely used to model time-series data in many...

Please sign up or login with your details

Forgot password? Click here to reset