Sequence stacking using dual encoder Seq2Seq recurrent networks

10/11/2017
by   Alessandro Bay, et al.
0

A widely studied non-polynomial (NP) hard problem lies in finding a route between the two nodes of a graph. Often meta-heuristics algorithms such as A^* are employed on graphs with a large number of nodes. Here, we propose a deep recurrent neural network architecture based on the Sequence-2-Sequence model, widely used, for instance in text translation. Particularly, we illustrate that utilising a context vector that has been learned from two different recurrent networks enables increased accuracies in learning the shortest route of a graph. Additionally, we show that one can boost the performance of the Seq2Seq network by smoothing the loss function using a homotopy continuation of the decoder's loss function.

READ FULL TEXT
research
10/11/2017

StackSeq2Seq: Dual Encoder Seq2Seq Recurrent Networks

A widely studied non-deterministic polynomial time (NP) hard problem lie...
research
09/07/2017

Approximating meta-heuristics with homotopic recurrent neural networks

Much combinatorial optimisation problems constitute a non-polynomial (NP...
research
10/25/2017

GeoSeq2Seq: Information Geometric Sequence-to-Sequence Networks

The Fisher information metric is an important foundation of information ...
research
12/20/2013

Generating Shortest Synchronizing Sequences using Answer Set Programming

For a finite state automaton, a synchronizing sequence is an input seque...
research
08/02/2017

Deep Recurrent Generative Decoder for Abstractive Text Summarization

We propose a new framework for abstractive text summarization based on a...
research
09/03/2019

DeepObfusCode: Source Code Obfuscation Through Sequence-to-Sequence Networks

The paper explores a novel methodology in source code obfuscation throug...
research
02/02/2021

Recurrent Neural Network for MoonBoard Climbing Route Classification and Generation

Classifying the difficulties of climbing routes and generating new route...

Please sign up or login with your details

Forgot password? Click here to reset