Greedy Compositional Clustering for Unsupervised Learning of Hierarchical Compositional Models

01/22/2017
by   Adam Kortylewski, et al.
0

This paper proposes to integrate a feature pursuit learning process into a greedy bottom-up learning scheme. The algorithm combines the benefits of bottom-up and top-down approaches for learning hierarchical models: It allows to induce the hierarchical structure of objects in an unsupervised manner, while avoiding a hard decision on the activation of parts. We follow the principle of compositionality by assembling higher-order parts from elements of lower layers in the hierarchy. The parts are learned greedily with an EM-type process that iterates between image encoding and part re-learning. The process stops when a candidate part is not able to find a free niche in the image. The algorithm proceeds layer by layer in a bottom-up manner until no further compositions are found. A subsequent top-down process composes the learned hierarchical shape vocabulary into a holistic object model. Experimental evaluation of the approach shows state-of-the-art performance on a domain adaptation task. Moreover, we demonstrate the capability of learning complex, semantically meaningful hierarchical compositional models without supervision.

READ FULL TEXT

page 3

page 12

research
10/21/2019

Generative Hierarchical Models for Parts, Objects, and Scenes

Compositional structures between parts and objects are inherent in natur...
research
01/21/2015

A Graph Theoretic Approach for Object Shape Representation in Compositional Hierarchies Using a Hybrid Generative-Descriptive Model

A graph theoretic approach is proposed for object shape representation i...
research
08/23/2014

Learning a Hierarchical Compositional Shape Vocabulary for Multi-class Object Representation

Hierarchies allow feature sharing between objects at multiple levels of ...
research
01/16/2013

Complexity of Representation and Inference in Compositional Models with Part Sharing

This paper describes serial and parallel compositional models of multipl...
research
09/10/2019

Towards Interpretable Image Synthesis by Learning Sparsely Connected AND-OR Networks

This paper proposes interpretable image synthesis by learning hierarchic...
research
11/11/2019

Compositional Hierarchical Tensor Factorization: Representing Hierarchical Intrinsic and Extrinsic Causal Factors

Visual objects are composed of a recursive hierarchy of perceptual whole...
research
04/14/2021

Compositional Hierarchical #Tensor Factorization: Representing Hierarchical Intrinsic and Extrinsic #Causal Factors #macinelearning #womenwhocode

Visual objects are composed of a recursive hierarchy of perceptual whole...

Please sign up or login with your details

Forgot password? Click here to reset