GEN Model: An Alternative Approach to Deep Neural Network Models

05/19/2018
by   Jiawei Zhang, et al.
0

In this paper, we introduce an alternative approach, namely GEN (Genetic Evolution Network) Model, to the deep learning models. Instead of building one single deep model, GEN adopts a genetic-evolutionary learning strategy to build a group of unit models generations by generations. Significantly different from the wellknown representation learning models with extremely deep structures, the unit models covered in GEN are of a much shallower architecture. In the training process, from each generation, a subset of unit models will be selected based on their performance to evolve and generate the child models in the next generation. GEN has significant advantages compared with existing deep representation learning models in terms of both learning effectiveness, efficiency and interpretability of the learning process and learned results. Extensive experiments have been done on diverse benchmark datasets, and the experimental results have demonstrated the outstanding performance of GEN compared with the state-of-the-art baseline methods in both effectiveness of efficiency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/23/2018

SEGEN: Sample-Ensemble Genetic Evolutional Network Model

Deep learning, a rebranding of deep neural network research works, has a...
research
05/19/2018

GADAM: Genetic-Evolutionary ADAM for Deep Neural Network Optimization

Deep neural network learning can be formulated as a non-convex optimizat...
research
05/19/2018

Deep Loopy Neural Network Model for Graph Structured Data Representation Learning

Existing deep learning models may encounter great challenges in handling...
research
06/08/2023

Robust Learning with Progressive Data Expansion Against Spurious Correlation

While deep learning models have shown remarkable performance in various ...
research
07/26/2019

BGADAM: Boosting based Genetic-Evolutionary ADAM for Convolutional Neural Network Optimization

Among various optimization algorithms, ADAM can achieve outstanding perf...
research
10/13/2022

NoMorelization: Building Normalizer-Free Models from a Sample's Perspective

The normalizing layer has become one of the basic configurations of deep...
research
03/20/2023

Unit Scaling: Out-of-the-Box Low-Precision Training

We present unit scaling, a paradigm for designing deep learning models t...

Please sign up or login with your details

Forgot password? Click here to reset