DeepAI AI Chat
Log In Sign Up

Distributed Evolution of Deep Autoencoders

by   Jeff Hajewski, et al.

Autoencoders have seen wide success in domains ranging from feature selection to information retrieval. Despite this success, designing an autoencoder for a given task remains a challenging undertaking due to the lack of firm intuition on how the backing neural network architectures of the encoder and decoder impact the overall performance of the autoencoder. In this work we present a distributed system that uses an efficient evolutionary algorithm to design a modular autoencoder. We demonstrate the effectiveness of this system on the tasks of manifold learning and image denoising. The system beats random search by nearly an order of magnitude on both tasks while achieving near linear horizontal scaling as additional worker nodes are added to the system.


page 13

page 16

page 17


Gradient Augmented Information Retrieval with Autoencoders and Semantic Hashing

This paper will explore the use of autoencoders for semantic hashing in ...

Training Invertible Neural Networks as Autoencoders

Autoencoders are able to learn useful data representations in an unsuper...

Decoding Stacked Denoising Autoencoders

Data representation in a stacked denoising autoencoder is investigated. ...

HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Coding

An autoencoder-based codec employs quantization to turn its bottleneck l...

EvoAAA: An evolutionary methodology for automated autoencoder architecture search

Machine learning models work better when curated features are provided t...

Concrete Autoencoders for Differentiable Feature Selection and Reconstruction

We introduce the concrete autoencoder, an end-to-end differentiable meth...

Loss Landscapes of Regularized Linear Autoencoders

Autoencoders are a deep learning model for representation learning. When...