Seq2Seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models

04/25/2018
by   Hendrik Strobelt, et al.
0

Neural Sequence-to-Sequence models have proven to be accurate and robust for many sequence prediction tasks, and have become the standard approach for automatic translation of text. The models work in a five stage blackbox process that involves encoding a source sequence to a vector space and then decoding out to a new target sequence. This process is now standard, but like many deep learning methods remains quite difficult to understand or debug. In this work, we present a visual analysis tool that allows interaction with a trained sequence-to-sequence model through each stage of the translation process. The aim is to identify which patterns have been learned and to detect model errors. We demonstrate the utility of our tool through several real-world large-scale sequence-to-sequence use cases.

READ FULL TEXT

page 2

page 6

page 8

research
10/29/2016

Sequence-to-sequence neural network models for transliteration

Transliteration is a key component of machine translation systems and so...
research
11/21/2019

Improving Conditioning in Context-Aware Sequence to Sequence Models

Neural sequence to sequence models are well established for applications...
research
06/09/2016

Sequence-to-Sequence Learning as Beam-Search Optimization

Sequence-to-Sequence (seq2seq) modeling has rapidly become an important ...
research
05/30/2019

Interactive-predictive neural multimodal systems

Despite the advances achieved by neural models in sequence to sequence l...
research
10/09/2019

A Deep Learning Based Chatbot for Campus Psychological Therapy

In this paper, we propose Evebot, an innovative, sequence to sequence (S...
research
04/01/2021

Do RNN States Encode Abstract Phonological Processes?

Sequence-to-sequence models have delivered impressive results in word fo...
research
11/14/2018

Predicting the time-evolution of multi-physics systems with sequence-to-sequence models

In this work, sequence-to-sequence (seq2seq) models, originally develope...

Please sign up or login with your details

Forgot password? Click here to reset