Pre-train and Plug-in: Flexible Conditional Text Generation with Variational Auto-Encoders

11/10/2019
by   Yu Duan, et al.
0

Current neural Natural Language Generation (NLG) models cannot handle emerging conditions due to their joint end-to-end learning fashion. When the need for generating text under a new condition emerges, these techniques require not only sufficiently supplementary labeled data but also a full re-training of the existing model. In this paper, we present a new framework named Hierarchical Neural Auto-Encoder (HAE) toward flexible conditional text generation. HAE decouples the text generation module from the condition representation module to allow "one-to-many" conditional generation. When a fresh condition emerges, only a lightweight network needs to be trained and works as a plug-in for HAE, which is efficient and desirable for real-world applications. Extensive experiments demonstrate the superiority of HAE against the existing alternatives with much less training time and fewer model parameters.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/07/2022

PCAE: A Framework of Plug-in Conditional Auto-Encoder for Controllable Text Generation

Controllable text generation has taken a gigantic step forward these day...
research
11/27/2017

Neural Text Generation: A Practical Guide

Deep learning methods have recently achieved great empirical success on ...
research
09/17/2017

Multi-Entity Dependence Learning with Rich Context via Conditional Variational Auto-encoder

Multi-Entity Dependence Learning (MEDL) explores conditional correlation...
research
07/16/2021

Urdu Hindi Poetry Generation using Neural Networks

One of the major problems writers and poets face is the writer's block. ...
research
03/26/2019

Improve Diverse Text Generation by Self Labeling Conditional Variational Auto Encoder

Diversity plays a vital role in many text generating applications. In re...
research
09/19/2022

CATER: Intellectual Property Protection on Text Generation APIs via Conditional Watermarks

Previous works have validated that text generation APIs can be stolen th...
research
12/01/2016

CDVAE: Co-embedding Deep Variational Auto Encoder for Conditional Variational Generation

Problems such as predicting a new shading field (Y) for an image (X) are...

Please sign up or login with your details

Forgot password? Click here to reset