Unsupervised semantic discovery through visual patterns detection

02/24/2021
by   Francesco Pelosin, et al.
0

We propose a new fast fully unsupervised method to discover semantic patterns. Our algorithm is able to hierarchically find visual categories and produce a segmentation mask where previous methods fail. Through the modeling of what is a visual pattern in an image, we introduce the notion of "semantic levels" and devise a conceptual framework along with measures and a dedicated benchmark dataset for future comparisons. Our algorithm is composed by two phases. A filtering phase, which selects semantical hotsposts by means of an accumulator space, then a clustering phase which propagates the semantic properties of the hotspots on a superpixels basis. We provide both qualitative and quantitative experimental validation, achieving optimal results in terms of robustness to noise and semantic consistency. We also made code and dataset publicly available.

READ FULL TEXT

page 2

page 7

research
04/22/2022

SegDiscover: Visual Concept Discovery via Unsupervised Semantic Segmentation

Visual concept discovery has long been deemed important to improve inter...
research
04/25/2022

Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers

Unsupervised semantic segmentation aims to discover groupings within and...
research
07/26/2021

Segmentation in Style: Unsupervised Semantic Image Segmentation with Stylegan and CLIP

We introduce a method that allows to automatically segment images into s...
research
04/27/2021

ACDC: The Adverse Conditions Dataset with Correspondences for Semantic Driving Scene Understanding

Level 5 autonomy for self-driving cars requires a robust visual percepti...
research
10/11/2022

Finding the global semantic representation in GAN through Frechet Mean

The ideally disentangled latent space in GAN involves the global represe...
research
05/13/2022

LSCDiscovery: A shared task on semantic change discovery and detection in Spanish

We present the first shared task on semantic change discovery and detect...

Please sign up or login with your details

Forgot password? Click here to reset