Deep Kernelized Autoencoders

02/08/2017
by   Michael Kampffmeyer, et al.
0

In this paper we introduce the deep kernelized autoencoder, a neural network model that allows an explicit approximation of (i) the mapping from an input space to an arbitrary, user-specified kernel space and (ii) the back-projection from such a kernel space to input space. The proposed method is based on traditional autoencoders and is trained through a new unsupervised loss function. During training, we optimize both the reconstruction accuracy of input samples and the alignment between a kernel matrix given as prior and the inner products of the hidden representations computed by the autoencoder. Kernel alignment provides control over the hidden representation learned by the autoencoder. Experiments have been performed to evaluate both reconstruction and kernel alignment performance. Additionally, we applied our method to emulate kPCA on a denoising task obtaining promising results.

READ FULL TEXT
research
07/19/2018

The Deep Kernelized Autoencoder

Autoencoders learn data representations (codes) in such a way that the i...
research
07/07/2019

Stacked autoencoders based machine learning for noise reduction and signal reconstruction in geophysical data

Autoencoders are neural network formulations where the input and output ...
research
05/05/2016

Rank Ordered Autoencoders

A new method for the unsupervised learning of sparse representations usi...
research
10/21/2021

On the Regularization of Autoencoders

While much work has been devoted to understanding the implicit (and expl...
research
10/15/2018

Supervised COSMOS Autoencoder: Learning Beyond the Euclidean Loss!

Autoencoders are unsupervised deep learning models used for learning rep...
research
06/25/2020

A New Modal Autoencoder for Functionally Independent Feature Extraction

Autoencoders have been widely used for dimensional reduction and feature...
research
07/09/2018

Using Swarm Optimization To Enhance Autoencoders Images

Autoencoders learn data representations through reconstruction. Robust t...

Please sign up or login with your details

Forgot password? Click here to reset