Learning Features and their Transformations by Spatial and Temporal Spherical Clustering

08/10/2013
by   Jayanta K. Dutta, et al.
0

Learning features invariant to arbitrary transformations in the data is a requirement for any recognition system, biological or artificial. It is now widely accepted that simple cells in the primary visual cortex respond to features while the complex cells respond to features invariant to different transformations. We present a novel two-layered feedforward neural model that learns features in the first layer by spatial spherical clustering and invariance to transformations in the second layer by temporal spherical clustering. Learning occurs in an online and unsupervised manner following the Hebbian rule. When exposed to natural videos acquired by a camera mounted on a cat's head, the first and second layer neurons in our model develop simple and complex cell-like receptive field properties. The model can predict by learning lateral connections among the first layer neurons. A topographic map to their spatial features emerges by exponentially decaying the flow of activation with distance from one neuron to another in the first layer that fire in close temporal proximity, thereby minimizing the pooling length in an online manner simultaneously with feature learning.

READ FULL TEXT

page 7

page 9

research
05/24/2023

Deep Equivariant Hyperspheres

This paper presents an approach to learning nD features equivariant unde...
research
07/24/2023

Unsupervised Learning of Invariance Transformations

The need for large amounts of training data in modern machine learning i...
research
01/15/2013

Auto-pooling: Learning to Improve Invariance of Image Features from Image Sequences

Learning invariant representations from images is one of the hardest cha...
research
06/18/2012

On multi-view feature learning

Sparse coding is a common approach to learning local features for object...
research
04/30/2020

Feedback U-net for Cell Image Segmentation

Human brain is a layered structure, and performs not only a feedforward ...
research
06/19/2020

Deep Transformation-Invariant Clustering

Recent advances in image clustering typically focus on learning better d...
research
01/22/2014

Learning Mid-Level Features and Modeling Neuron Selectivity for Image Classification

We now know that mid-level features can greatly enhance the performance ...

Please sign up or login with your details

Forgot password? Click here to reset