DeepAI AI Chat
Log In Sign Up

Mitigating Negative Style Transfer in Hybrid Dialogue System

by   Shimin Li, et al.
FUDAN University

As the functionality of dialogue systems evolves, hybrid dialogue systems that accomplish user-specific goals and participate in open-topic chitchat with users are attracting growing attention. Existing research learns both tasks concurrently utilizing a multi-task fusion technique but ignores the negative transfer phenomenon induced by the unique textual style differences. Therefore, contrastive learning based on the latent variable model is used to decouple the various textual genres in the latent space. We devise supervised and self-supervised positive and negative sample constructions for diverse datasets. In addition, to capitalize on the style information contained in the decoupled latent variables, we employ a style prefix that incorporates latent variables further to control the generation of responses with varying styles. We performed extensive experiments on three dialogue datasets, including a hybrid dialogue dataset and two task-oriented dialogue datasets. The experimental results demonstrate that our method can mitigate the negative style transfer issue and achieves state-of-the-art performance on multiple dialogue datasets.


page 1

page 2

page 3

page 4


Towards Diverse, Relevant and Coherent Open-Domain Dialogue Generation via Hybrid Latent Variables

Conditional variational models, using either continuous or discrete late...

External Knowledge Selection with Weighted Negative Sampling in Knowledge-grounded Task-oriented Dialogue Systems

Constructing a robust dialogue system on spoken conversations bring more...

Transformer-Based Conditioned Variational Autoencoder for Dialogue Generation

In human dialogue, a single query may elicit numerous appropriate respon...

Disentangled Representation Learning for Text Style Transfer

This paper tackles the problem of disentangling the latent variables of ...

Stylistic Retrieval-based Dialogue System with Unparallel Training Data

The ability of a dialog system to express consistent language style duri...

Hybrid Supervised Reinforced Model for Dialogue Systems

This paper presents a recurrent hybrid model and training procedure for ...