Human-like Clustering with Deep Convolutional Neural Networks

06/15/2017
by   Ali Borji, et al.
0

Classification and clustering have been studied separately in machine learning and computer vision. Inspired by the recent success of deep learning models in solving various vision problems (e.g., object recognition, semantic segmentation) and the fact that humans serve as the gold standard in assessing clustering algorithms, here, we advocate for a unified treatment of the two problems and suggest that hierarchical frameworks that progressively build complex patterns on top of the simpler ones (e.g., convolutional neural networks) offer a promising solution. We do not dwell much on the learning mechanisms in these frameworks as they are still a matter of debate, with respect to biological constraints. Instead, we emphasize on the compositionality of the real world structures and objects. In particular, we show that CNNs, trained end to end using back propagation with noisy labels, are able to cluster data points belonging to several overlapping shapes, and do so much better than the state of the art algorithms. The main takeaway lesson from our study is that mechanisms of human vision, particularly the hierarchal organization of the visual ventral stream should be taken into account in clustering algorithms (e.g., for learning representations in an unsupervised manner or with minimum supervision) to reach human level clustering performance. This, by no means, suggests that other methods do not hold merits. For example, methods relying on pairwise affinities (e.g., spectral clustering) have been very successful in many scenarios but still fail in some cases (e.g., overlapping clusters).

READ FULL TEXT
research
01/20/2020

Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Future

Convolutional neural networks (CNNs) were inspired by early findings in ...
research
07/15/2018

Deep Clustering for Unsupervised Learning of Visual Features

Clustering is a class of unsupervised learning methods that has been ext...
research
05/15/2021

Are Convolutional Neural Networks or Transformers more like human vision?

Modern machine learning models for computer vision exceed humans in accu...
research
06/08/2017

Leveraging deep neural networks to capture psychological representations

Artificial neural networks have seen a recent surge in popularity for th...
research
04/06/2023

Learning Neural Eigenfunctions for Unsupervised Semantic Segmentation

Unsupervised semantic segmentation is a long-standing challenge in compu...
research
08/13/2022

Modeling Biological Face Recognition with Deep Convolutional Neural Networks

Deep Convolutional Neural Networks (DCNNs) have become the state-of-the-...

Please sign up or login with your details

Forgot password? Click here to reset