Big GANs Are Watching You: Towards Unsupervised Object Segmentation with Off-the-Shelf Generative Models

06/08/2020
by   Andrey Voynov, et al.
0

Since collecting pixel-level groundtruth data is expensive, unsupervised visual understanding problems are currently an active research topic. In particular, several recent methods based on generative models have achieved promising results for object segmentation and saliency detection. However, since generative models are known to be unstable and sensitive to hyperparameters, the training of these methods can be challenging and time-consuming. In this work, we introduce an alternative, much simpler way to exploit generative models for unsupervised object segmentation. First, we explore the latent space of the BigBiGAN – the state-of-the-art unsupervised GAN, which parameters are publicly available. We demonstrate that object saliency masks for GAN-produced images can be obtained automatically with BigBiGAN. These masks then are used to train a discriminative segmentation model. Being very simple and easy-to-reproduce, our approach provides competitive performance on common benchmarks in the unsupervised scenario.

READ FULL TEXT

page 4

page 5

page 7

research
11/28/2021

Learning To Segment Dominant Object Motion From Watching Videos

Existing deep learning based unsupervised video object segmentation meth...
research
12/15/2022

Unsupervised Object Localization: Observing the Background to Discover Objects

Recent advances in self-supervised visual representation learning have p...
research
10/13/2021

Unsupervised Object Learning via Common Fate

Learning generative object models from unlabelled videos is a long stand...
research
05/17/2021

Finding an Unsupervised Image Segmenter in Each of Your Deep Generative Models

Recent research has shown that numerous human-interpretable directions e...
research
02/21/2019

Latent Translation: Crossing Modalities by Bridging Generative Models

End-to-end optimization has achieved state-of-the-art performance on man...
research
03/17/2023

DiffusionSeg: Adapting Diffusion Towards Unsupervised Object Discovery

Learning from a large corpus of data, pre-trained models have achieved i...
research
08/04/2021

Free Lunch for Co-Saliency Detection: Context Adjustment

We unveil a long-standing problem in the prevailing co-saliency detectio...

Please sign up or login with your details

Forgot password? Click here to reset