vix.ing · top · new · best · stats · spec

StackSeq2Seq: Dual Encoder Seq2Seq Recurrent Networks

2017/10/11 by Alessandro Bay, Biswa Sengupta, Bay, Alessandro +1
Biochemistry, Genetics and Molecular Biology · Computer Science · #Machine Learning in Bioinformatics #Natural Language Processing Techniques #Software Engineering Research

paper · pdf · doi:10.48550/arxiv.1710.04211

Abstract

A widely studied non-deterministic polynomial time (NP) hard problem lies in finding a route between the two nodes of a graph. Often meta-heuristics algorithms such as A* are employed on graphs with a large number of nodes. Here, we propose a deep recurrent neural network architecture based on the Sequence-2-Sequence (Seq2Seq) model, widely used, for instance in text translation. Particularly, we illustrate that utilising a context vector that has been learned from two different recurrent networks enables increased accuracies in learning the shortest route of a graph. Additionally, we show that one can boost the performance of the Seq2Seq network by smoothing the loss function using a homotopy continuation of the decoder's loss function.

Citations

Related