Natural Language Generation as Planning under Uncertainty Using Reinforcement Learning

06/15/2016
by   Verena Rieser, et al.
0

We present and evaluate a new model for Natural Language Generation (NLG) in Spoken Dialogue Systems, based on statistical planning, given noisy feedback from the current generation context (e.g. a user and a surface realiser). We study its use in a standard NLG problem: how to present information (in this case a set of search results) to users, given the complex trade- offs between utterance length, amount of information conveyed, and cognitive load. We set these trade-offs by analysing existing MATCH data. We then train a NLG pol- icy using Reinforcement Learning (RL), which adapts its behaviour to noisy feed- back from the current generation context. This policy is compared to several base- lines derived from previous work in this area. The learned policy significantly out- performs all the prior approaches.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/16/2022

Adaptive Natural Language Generation for Task-oriented Dialogue via Reinforcement Learning

When a natural language generation (NLG) component is implemented in a r...
research
08/03/2023

Investigating Reinforcement Learning for Communication Strategies in a Task-Initiative Setting

Many conversational domains require the system to present nuanced inform...
research
10/16/2019

Adaptive Trade-Offs in Off-Policy Learning

A great variety of off-policy learning algorithms exist in the literatur...
research
08/23/2022

GenTUS: Simulating User Behaviour and Language in Task-oriented Dialogues with Generative Transformers

User simulators (USs) are commonly used to train task-oriented dialogue ...
research
09/22/2020

Controlling Style in Generated Dialogue

Open-domain conversation models have become good at generating natural-s...
research
11/26/2019

Natural Language Generation Using Reinforcement Learning with External Rewards

We propose an approach towards natural language generation using a bidir...
research
06/10/2016

Conditional Generation and Snapshot Learning in Neural Dialogue Systems

Recently a variety of LSTM-based conditional language models (LM) have b...

Please sign up or login with your details

Forgot password? Click here to reset