Learning Sequence Neighbourhood Metrics

09/09/2011
by   Justin Bayer, et al.
0

Recurrent neural networks (RNNs) in combination with a pooling operator and the neighbourhood components analysis (NCA) objective function are able to detect the characterizing dynamics of sequences and embed them into a fixed-length vector space of arbitrary dimensionality. Subsequently, the resulting features are meaningful and can be used for visualization or nearest neighbour classification in linear time. This kind of metric learning for sequential data enables the use of algorithms tailored towards fixed length vector spaces such as R^n.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/17/2019

Multi-Zone Unit for Recurrent Neural Networks

Recurrent neural networks (RNNs) have been widely used to deal with sequ...
research
10/27/2020

Wearing a MASK: Compressed Representations of Variable-Length Sequences Using Recurrent Neural Tangent Kernels

High dimensionality poses many challenges to the use of data, from visua...
research
02/04/2019

Can SGD Learn Recurrent Neural Networks with Provable Generalization?

Recurrent Neural Networks (RNNs) are among the most popular models in se...
research
09/12/2017

Parallelizing Linear Recurrent Neural Nets Over Sequence Length

Recurrent neural networks (RNNs) are widely used to model sequential dat...
research
07/10/2018

Recurrent Auto-Encoder Model for Large-Scale Industrial Sensor Signal Analysis

Recurrent auto-encoder model summarises sequential data through an encod...
research
07/30/2018

Human Motion Analysis with Deep Metric Learning

Effectively measuring the similarity between two human motions is necess...
research
12/20/2017

Dataflow Matrix Machines and V-values: a Bridge between Programs and Neural Nets

Dataflow matrix machines generalize neural nets by replacing streams of ...

Please sign up or login with your details

Forgot password? Click here to reset