Hierarchical Text Generation and Planning for Strategic Dialogue

12/15/2017
by   Denis Yarats, et al.
0

End-to-end models for strategic dialogue are challenging to train, because linguistic and strategic aspects are entangled in latent state vectors. We introduce an approach to generating latent representations of dialogue moves, by inducing sentence representations to maximize the likelihood of subsequent sentences and actions. The effect is to decouple much of the semantics of the utterance from its linguistic realisation. We then use these latent sentence representations for hierarchical language generation, planning and reinforcement learning. Experiments show that using our message representations increases the reward achieved by the model, improves the effectiveness of long-term planning using rollouts, and allows self-play reinforcement learning to improve decision making without diverging from human language. Our hierarchical latent-variable model outperforms previous work both linguistically and strategically.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/19/2019

Long and Diverse Text Generation with Planning-based Hierarchical Variational Model

Existing neural methods for data-to-text generation are still struggling...
research
05/29/2017

Latent Intention Dialogue Models

Developing a dialogue agent that is capable of making autonomous decisio...
research
05/24/2020

GoChat: Goal-oriented Chatbots with Hierarchical Reinforcement Learning

A chatbot that converses like a human should be goal-oriented (i.e., be ...
research
12/18/2019

MALA: Cross-Domain Dialogue Generation with Action Learning

Response generation for task-oriented dialogues involves two basic compo...
research
06/03/2019

Hierarchical Decision Making by Generating and Following Natural Language Instructions

We explore using latent natural language instructions as an expressive a...
research
09/19/2018

Investigating Linguistic Pattern Ordering in Hierarchical Natural Language Generation

Natural language generation (NLG) is a critical component in spoken dial...
research
06/10/2021

AGGGEN: Ordering and Aggregating while Generating

We present AGGGEN (pronounced 'again'), a data-to-text model which re-in...

Please sign up or login with your details

Forgot password? Click here to reset