Unsupervised Part Discovery by Unsupervised Disentanglement

09/09/2020
by   Sandro Braun, et al.
4

We address the problem of discovering part segmentations of articulated objects without supervision. In contrast to keypoints, part segmentations provide information about part localizations on the level of individual pixels. Capturing both locations and semantics, they are an attractive target for supervised learning approaches. However, large annotation costs limit the scalability of supervised algorithms to other object categories than humans. Unsupervised approaches potentially allow to use much more data at a lower cost. Most existing unsupervised approaches focus on learning abstract representations to be refined with supervision into the final representation. Our approach leverages a generative model consisting of two disentangled representations for an object's shape and appearance and a latent variable for the part segmentation. From a single image, the trained model infers a semantic part segmentation map. In experiments, we compare our approach to previous state-of-the-art approaches and observe significant gains in segmentation accuracy and shape consistency. Our work demonstrates the feasibility to discover semantic part segmentations without supervision.

READ FULL TEXT

page 9

page 22

page 24

page 25

page 26

page 27

page 28

page 29

research
03/16/2019

Unsupervised Part-Based Disentangling of Object Shape and Appearance

Large intra-class variation is the result of changes in multiple object ...
research
12/15/2022

Unsupervised Object Localization: Observing the Background to Discover Objects

Recent advances in self-supervised visual representation learning have p...
research
03/30/2023

Removing supervision in semantic segmentation with local-global matching and area balancing

Removing supervision in semantic segmentation is still tricky. Current a...
research
03/28/2020

Inferring Semantic Information with 3D Neural Scene Representations

Biological vision infers multi-modal 3D representations that support rea...
research
07/03/2020

Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation

This paper studies the problem of learning semantic segmentation from im...
research
05/26/2021

Unsupervised Part Segmentation through Disentangling Appearance and Shape

We study the problem of unsupervised discovery and segmentation of objec...
research
06/10/2021

Unsupervised Co-part Segmentation through Assembly

Co-part segmentation is an important problem in computer vision for its ...

Please sign up or login with your details

Forgot password? Click here to reset