DeepAI AI Chat
Log In Sign Up

Unsupervised Discovery of the Long-Tail in Instance Segmentation Using Hierarchical Self-Supervision

by   Zhenzhen Weng, et al.

Instance segmentation is an active topic in computer vision that is usually solved by using supervised learning approaches over very large datasets composed of object level masks. Obtaining such a dataset for any new domain can be very expensive and time-consuming. In addition, models trained on certain annotated categories do not generalize well to unseen objects. The goal of this paper is to propose a method that can perform unsupervised discovery of long-tail categories in instance segmentation, through learning instance embeddings of masked regions. Leveraging rich relationship and hierarchical structure between objects in the images, we propose self-supervised losses for learning mask embeddings. Trained on COCO dataset without additional annotations of the long-tail objects, our model is able to discover novel and more fine-grained objects than the common categories in COCO. We show that the model achieves competitive quantitative results on LVIS as compared to the supervised and partially supervised methods.


page 1

page 4

page 7

page 8

page 10

page 11


Learning to Segment Every Thing

Existing methods for object instance segmentation require all training i...

Unsupervised Object Segmentation by Redrawing

Object segmentation is a crucial problem that is usually solved by using...

Commonality-Parsing Network across Shape and Appearance for Partially Supervised Instance Segmentation

Partially supervised instance segmentation aims to perform learning on l...

Classification Calibration for Long-tail Instance Segmentation

Remarkable progress has been made in object instance detection and segme...

The Pursuit of Knowledge: Discovering and Localizing Novel Categories using Dual Memory

We tackle object category discovery, which is the problem of discovering...

ContrastMask: Contrastive Learning to Segment Every Thing

Partially-supervised instance segmentation is a task which requests segm...