Online Representation Learning with Multi-layer Hebbian Networks for Image Classification Tasks

02/21/2017
by   Yanis Bahroun, et al.
0

Unsupervised learning permits the development of algorithms that are able to adapt to a variety of different data sets using the same underlying rules thanks to the autonomous discovery of discriminating features during training. Recently, a new class of Hebbian-like and local unsupervised learning rules for neural networks have been developed that minimise a similarity matching cost-function. These have been shown to perform sparse representation learning. This study tests the effectiveness of one such learning rule for learning features from images. The rule implemented is derived from a nonnegative classical multidimensional scaling cost-function, and is applied to both single and multi-layer architectures. The features learned by the algorithm are then used as input to an SVM to test their effectiveness in classification on the established CIFAR-10 image dataset. The algorithm performs well in comparison to other unsupervised learning algorithms and multi-layer networks, thus suggesting its validity in the design of a new class of compact, online learning networks.

READ FULL TEXT
research
02/04/2019

A Spiking Neural Network with Local Learning Rules Derived From Nonnegative Similarity Matching

The design and analysis of spiking neural network algorithms will be acc...
research
08/05/2019

Neuroscience-inspired online unsupervised learning algorithms

Although the currently popular deep learning networks achieve unpreceden...
research
02/05/2020

Dropout Prediction over Weeks in MOOCs via Interpretable Multi-Layer Representation Learning

Massive Open Online Courses (MOOCs) have become popular platforms for on...
research
12/04/2018

From biological vision to unsupervised hierarchical sparse coding

The formation of connections between neural cells is emerging essentiall...
research
05/24/2017

Unsupervised Learning Layers for Video Analysis

This paper presents two unsupervised learning layers (UL layers) for lab...
research
03/31/2018

Learning Unsupervised Learning Rules

A major goal of unsupervised learning is to discover data representation...
research
07/27/2022

Multi-layer Representation Learning for Robust OOD Image Classification

Convolutional Neural Networks have become the norm in image classificati...

Please sign up or login with your details

Forgot password? Click here to reset