Fine Grained Knowledge Transfer for Personalized Task-oriented Dialogue Systems

11/11/2017
by   Kaixiang Mo, et al.
0

Training a personalized dialogue system requires a lot of data, and the data collected for a single user is usually insufficient. One common practice for this problem is to share training dialogues between different users and train multiple sequence-to-sequence dialogue models together with transfer learning. However, current sequence-to-sequence transfer learning models operate on the entire sentence, which might cause negative transfer if different personal information from different users is mixed up. We propose a personalized decoder model to transfer finer granularity phrase-level knowledge between different users while keeping personal preferences of each user intact. A novel personal control gate is introduced, enabling the personalized decoder to switch between generating personalized phrases and shared phrases. The proposed personalized decoder model can be easily combined with various deep models and can be trained with reinforcement learning. Real-world experimental results demonstrate that the phrase-level personalized decoder improves the BLEU over multiple sentence-level transfer baseline models by as much as 7.5

READ FULL TEXT

page 6

page 7

research
10/10/2016

Personalizing a Dialogue System with Transfer Reinforcement Learning

It is difficult to train a personalized task-oriented dialogue system be...
research
01/13/2017

Efficient Transfer Learning Schemes for Personalized Language Modeling using Recurrent Neural Network

In this paper, we propose an efficient transfer leaning methods for trai...
research
08/25/2023

An Ensemble Approach to Personalized Real Time Predictive Writing for Experts

Completing a sentence, phrase or word after typing few words / character...
research
10/17/2022

MCP: Self-supervised Pre-training for Personalized Chatbots with Multi-level Contrastive Sampling

Personalized chatbots focus on endowing the chatbots with a consistent p...
research
06/13/2023

PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer

Personalized dialogue agents (DAs) powered by large pre-trained language...
research
04/11/2018

Personalized Dynamics Models for Adaptive Assistive Navigation Interfaces

We explore the role of personalization for assistive navigational system...
research
06/16/2019

Persuasion for Good: Towards a Personalized Persuasive Dialogue System for Social Good

Developing intelligent persuasive conversational agents to change people...

Please sign up or login with your details

Forgot password? Click here to reset