Interactive-Predictive Neural Machine Translation through Reinforcement and Imitation

07/04/2019
by   Tsz Kin Lam, et al.
0

We propose an interactive-predictive neural machine translation framework for easier model personalization using reinforcement and imitation learning. During the interactive translation process, the user is asked for feedback on uncertain locations identified by the system. Responses are weak feedback in the form of "keep" and "delete" edits, and expert demonstrations in the form of "substitute" edits. Conditioning on the collected feedback, the system creates alternative translations via constrained beam search. In simulation experiments on two language pairs our systems get close to the performance of supervised training with much less human effort.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/03/2018

A Reinforcement Learning Approach to Interactive-Predictive Neural Machine Translation

We present an approach to interactive-predictive neural machine translat...
research
06/19/2018

Learning from Chunk-based Feedback in Neural Machine Translation

We empirically investigate learning from partial feedback in neural mach...
research
07/24/2017

Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback

Machine translation is a natural candidate problem for reinforcement lea...
research
04/16/2018

Can Neural Machine Translation be Improved with User Feedback?

We present the first real-world application of methods for improving neu...
research
05/20/2019

A Neural, Interactive-predictive System for Multimodal Sequence to Sequence Tasks

We present a demonstration of a neural interactive-predictive system for...
research
07/11/2019

Self-Regulated Interactive Sequence-to-Sequence Learning

Not all types of supervision signals are created equal: Different types ...
research
04/23/2020

Correct Me If You Can: Learning from Error Corrections and Markings

Sequence-to-sequence learning involves a trade-off between signal streng...

Please sign up or login with your details

Forgot password? Click here to reset