A new Sparse Auto-encoder based Framework using Grey Wolf Optimizer for Data Classification Problem

01/29/2022
by   Ahmad Mozaffer Karim, et al.
0

One of the most important properties of deep auto-encoders (DAEs) is their capability to extract high level features from row data. Hence, especially recently, the autoencoders are preferred to be used in various classification problems such as image and voice recognition, computer security, medical data analysis, etc. Despite, its popularity and high performance, the training phase of autoencoders is still a challenging task, involving to select best parameters that let the model to approach optimal results. Different training approaches are applied to train sparse autoencoders. Previous studies and preliminary experiments reveal that those approaches may present remarkable results in same problems but also disappointing results can be obtained in other complex problems. Metaheuristic algorithms have emerged over the last two decades and are becoming an essential part of contemporary optimization techniques. Gray wolf optimization (GWO) is one of the current of those algorithms and is applied to train sparse auto-encoders for this study. This model is validated by employing several popular Gene expression databases. Results are compared with previous state-of-the art methods studied with the same data sets and also are compared with other popular metaheuristic algorithms, namely, Genetic Algorithms (GA), Particle Swarm Optimization (PSO) and Artificial Bee Colony (ABC). Results reveal that the performance of the trained model using GWO outperforms on both conventional models and models trained with most popular metaheuristic algorithms.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2017

A Particle Swarm Optimization-based Flexible Convolutional Auto-Encoder for Image Classification

Convolutional auto-encoders have shown their remarkable performance in s...
research
10/10/2021

Mixture Model Auto-Encoders: Deep Clustering through Dictionary Learning

State-of-the-art approaches for clustering high-dimensional data utilize...
research
08/23/2020

Dual Adversarial Auto-Encoders for Clustering

As a powerful approach for exploratory data analysis, unsupervised clust...
research
02/28/2019

Unsupervised Abnormality Detection through Mixed Structure Regularization (MSR) in Deep Sparse Autoencoders

Deep sparse auto-encoders with mixed structure regularization (MSR) in a...
research
02/23/2015

Optimal Sparse Linear Auto-Encoders and Sparse PCA

Principal components analysis (PCA) is the optimal linear auto-encoder o...
research
12/02/2012

Metaheuristic Optimization: Algorithm Analysis and Open Problems

Metaheuristic algorithms are becoming an important part of modern optimi...
research
01/02/2023

OF-AE: Oblique Forest AutoEncoders

In the present work we propose an unsupervised ensemble method consistin...

Please sign up or login with your details

Forgot password? Click here to reset