Unsupervised Co-part Segmentation through Assembly

06/10/2021
by   Qingzhe Gao, et al.
11

Co-part segmentation is an important problem in computer vision for its rich applications. We propose an unsupervised learning approach for co-part segmentation from images. For the training stage, we leverage motion information embedded in videos and explicitly extract latent representations to segment meaningful object parts. More importantly, we introduce a dual procedure of part-assembly to form a closed loop with part-segmentation, enabling an effective self-supervision. We demonstrate the effectiveness of our approach with a host of extensive experiments, ranging from human bodies, hands, quadruped, and robot arms. We show that our approach can achieve meaningful and compact part segmentation, outperforming state-of-the-art approaches on diverse benchmarks.

READ FULL TEXT

page 5

page 7

page 8

page 9

research
05/16/2022

Guess What Moves: Unsupervised Video and Image Segmentation by Anticipating Motion

Motion, measured via optical flow, provides a powerful cue to discover a...
research
04/05/2019

Unsupervised Image Matching and Object Discovery as Optimization

Learning with complete or partial supervision is powerful but relies on ...
research
08/22/2023

LOCATE: Self-supervised Object Discovery via Flow-guided Graph-cut and Bootstrapped Self-training

Learning object segmentation in image and video datasets without human s...
research
07/23/2019

A system for efficient 3D printed stop-motion face animation

Computer animation in conjunction with 3D printing has the potential to ...
research
10/21/2022

Unsupervised Multi-object Segmentation by Predicting Probable Motion Patterns

We propose a new approach to learn to segment multiple image objects wit...
research
12/19/2016

Learning Features by Watching Objects Move

This paper presents a novel yet intuitive approach to unsupervised featu...
research
09/09/2020

Unsupervised Part Discovery by Unsupervised Disentanglement

We address the problem of discovering part segmentations of articulated ...

Please sign up or login with your details

Forgot password? Click here to reset