DeepAI AI Chat
Log In Sign Up

Distributed Evolution of Deep Autoencoders

04/16/2020
by   Jeff Hajewski, et al.
Salesforce
0

Autoencoders have seen wide success in domains ranging from feature selection to information retrieval. Despite this success, designing an autoencoder for a given task remains a challenging undertaking due to the lack of firm intuition on how the backing neural network architectures of the encoder and decoder impact the overall performance of the autoencoder. In this work we present a distributed system that uses an efficient evolutionary algorithm to design a modular autoencoder. We demonstrate the effectiveness of this system on the tasks of manifold learning and image denoising. The system beats random search by nearly an order of magnitude on both tasks while achieving near linear horizontal scaling as additional worker nodes are added to the system.

READ FULL TEXT

page 13

page 16

page 17

03/12/2018

Gradient Augmented Information Retrieval with Autoencoders and Semantic Hashing

This paper will explore the use of autoencoders for semantic hashing in ...
03/20/2023

Training Invertible Neural Networks as Autoencoders

Autoencoders are able to learn useful data representations in an unsuper...
05/10/2016

Decoding Stacked Denoising Autoencoders

Data representation in a stacked denoising autoencoder is investigated. ...
07/22/2021

HARP-Net: Hyper-Autoencoded Reconstruction Propagation for Scalable Neural Audio Coding

An autoencoder-based codec employs quantization to turn its bottleneck l...
01/15/2023

EvoAAA: An evolutionary methodology for automated autoencoder architecture search

Machine learning models work better when curated features are provided t...
01/27/2019

Concrete Autoencoders for Differentiable Feature Selection and Reconstruction

We introduce the concrete autoencoder, an end-to-end differentiable meth...
01/23/2019

Loss Landscapes of Regularized Linear Autoencoders

Autoencoders are a deep learning model for representation learning. When...