Fine Tuning Method by using Knowledge Acquisition from Deep Belief Network

07/10/2018

∙

We developed an adaptive structure learning method of Restricted Boltzmann Machine (RBM) which can generate/annihilate neurons by self-organizing learning method according to input patterns. Moreover, the adaptive Deep Belief Network (DBN) in the assemble process of pre-trained RBM layer was developed. The proposed method presents to score a great success to the training data set for big data benchmark test such as CIFAR-10. However, the classification capability of the test data set, which are included unknown patterns, is high, but does not lead perfect correct solution. We investigated the wrong specified data and then some characteristic patterns were found. In this paper, the knowledge related to the patterns is embedded into the classification algorithm of trained DBN. As a result, the classification capability can achieve a great success (97.1% to unknown data set).

READ FULL TEXT

Fine Tuning Method by using Knowledge Acquisition from Deep Belief Network

Adaptive Learning Method of Recurrent Temporal Deep Belief Network to Analyze Time Series Data

An Adaptive Learning Method of Deep Belief Network by Layer Generation Algorithm

An Embedded System for Image-based Crack Detection by using Fine-Tuning model of Adaptive Structural Learning of Deep Belief Network

An Adaptive Structural Learning of Deep Belief Network for Image-based Crack Detection in Concrete Structures Using SDNET2018

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control

Deep Belief Network Training Improvement Using Elite Samples Minimizing Free Energy

Nucleus Neural Network: A Data-driven Self-organized Architecture

Fine Tuning Method by using Knowledge Acquisition from Deep Belief Network

Related Research

Adaptive Learning Method of Recurrent Temporal Deep Belief Network to Analyze Time Series Data

An Adaptive Learning Method of Deep Belief Network by Layer Generation Algorithm

An Embedded System for Image-based Crack Detection by using Fine-Tuning model of Adaptive Structural Learning of Deep Belief Network

An Adaptive Structural Learning of Deep Belief Network for Image-based Crack Detection in Concrete Structures Using SDNET2018

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control

Deep Belief Network Training Improvement Using Elite Samples Minimizing Free Energy

Nucleus Neural Network: A Data-driven Self-organized Architecture