Motion-supervised Co-Part Segmentation

04/07/2020
by   Aliaksandr Siarohin, et al.
1

Recent co-part segmentation methods mostly operate in a supervised learning setting, which requires a large amount of annotated data for training. To overcome this limitation, we propose a self-supervised deep learning method for co-part segmentation. Differently from previous works, our approach develops the idea that motion information inferred from videos can be leveraged to discover meaningful object parts. To this end, our method relies on pairs of frames sampled from the same video. The network learns to predict part segments together with a representation of the motion between two frames, which permits reconstruction of the target image. Through extensive experimental evaluation on publicly available video sequences we demonstrate that our approach can produce improved segmentation maps with respect to previous self-supervised co-part segmentation approaches.

READ FULL TEXT

page 10

page 14

page 21

page 22

page 23

page 24

page 25

page 26

research
05/03/2019

SCOPS: Self-Supervised Co-Part Segmentation

Parts provide a good intermediate representation of objects that is robu...
research
10/23/2022

Self-supervised Amodal Video Object Segmentation

Amodal perception requires inferring the full shape of an object that is...
research
08/18/2020

Self-supervised Sparse to Dense Motion Segmentation

Observable motion in videos can give rise to the definition of objects m...
research
11/06/2020

"What's This?" – Learning to Segment Unknown Objects from Manipulation Sequences

We present a novel framework for self-supervised grasped object segmenta...
research
07/31/2023

Towards Unbalanced Motion: Part-Decoupling Network for Video Portrait Segmentation

Video portrait segmentation (VPS), aiming at segmenting prominent foregr...
research
07/16/2020

Self-Supervised Nuclei Segmentation in Histopathological Images Using Attention

Segmentation and accurate localization of nuclei in histopathological im...
research
02/14/2022

Box Supervised Video Segmentation Proposal Network

Video Object Segmentation (VOS) has been targeted by various fully-super...

Please sign up or login with your details

Forgot password? Click here to reset