An Introduction to Autoencoders

01/11/2022
by   Umberto Michelucci, et al.
6

In this article, we will look at autoencoders. This article covers the mathematics and the fundamental concepts of autoencoders. We will discuss what they are, what the limitations are, the typical use cases, and we will look at some examples. We will start with a general introduction to autoencoders, and we will discuss the role of the activation function in the output layer and the loss function. We will then discuss what the reconstruction error is. Finally, we will look at typical applications as dimensionality reduction, classification, denoising, and anomaly detection. This paper contains the notes of a PhD-level lecture on autoencoders given in 2021.

READ FULL TEXT

page 12

page 13

page 14

page 19

page 20

page 21

page 25

page 26

research
06/06/2019

An Introduction to Variational Autoencoders

Variational autoencoders provide a principled framework for learning dee...
research
09/04/2023

Are We Using Autoencoders in a Wrong Way?

Autoencoders are certainly among the most studied and used Deep Learning...
research
11/24/2021

Particle Graph Autoencoders and Differentiable, Learned Energy Mover's Distance

Autoencoders have useful applications in high energy physics in anomaly ...
research
08/15/2022

On a Mechanism Framework of Autoencoders

This paper proposes a theoretical framework on the mechanism of autoenco...
research
10/28/2021

How to boost autoencoders?

Autoencoders are a category of neural networks with applications in nume...
research
02/13/2014

Zero-bias autoencoders and the benefits of co-adapting features

Regularized training of an autoencoder typically results in hidden unit ...
research
02/18/2020

Balancing reconstruction error and Kullback-Leibler divergence in Variational Autoencoders

In the loss function of Variational Autoencoders there is a well known t...

Please sign up or login with your details

Forgot password? Click here to reset