Unsupervised Learning of Image Segmentation Based on Differentiable Feature Clustering

07/20/2020
by   Wonjik Kim, et al.
0

The usage of convolutional neural networks (CNNs) for unsupervised image segmentation was investigated in this study. In the proposed approach, label prediction and network parameter learning are alternately iterated to meet the following criteria: (a) pixels of similar features should be assigned the same label, (b) spatially continuous pixels should be assigned the same label, and (c) the number of unique labels should be large. Although these criteria are incompatible, the proposed approach minimizes the combination of similarity loss and spatial continuity loss to find a plausible solution of label assignment that balances the aforementioned criteria well. The contributions of this study are four-fold. First, we propose a novel end-to-end network of unsupervised image segmentation that consists of normalization and an argmax function for differentiable clustering. Second, we introduce a spatial continuity loss function that mitigates the limitations of fixed segment boundaries possessed by previous work. Third, we present an extension of the proposed method for segmentation with scribbles as user input, which showed better accuracy than existing methods while maintaining efficiency. Finally, we introduce another extension of the proposed method: unseen image segmentation by using networks pre-trained with a few reference images without re-training the networks. The effectiveness of the proposed approach was examined on several benchmark datasets of image segmentation.

READ FULL TEXT

page 1

page 7

page 8

page 9

page 10

page 12

page 13

page 14

research
02/13/2020

Simple Interactive Image Segmentation using Label Propagation through kNN graphs

Many interactive image segmentation techniques are based on semi-supervi...
research
01/20/2021

Nonparametric clustering for image segmentation

Image segmentation aims at identifying regions of interest within an ima...
research
12/06/2016

FLIC: Fast Linear Iterative Clustering with Active Search

Benefiting from its high efficiency and simplicity, Simple Linear Iterat...
research
07/30/2021

Iterative, Deep, and Unsupervised Synthetic Aperture Sonar Image Segmentation

Deep learning has not been routinely employed for semantic segmentation ...
research
09/20/2023

3D-U-SAM Network For Few-shot Tooth Segmentation in CBCT Images

Accurate representation of tooth position is extremely important in trea...
research
04/11/2023

Amortized Learning of Dynamic Feature Scaling for Image Segmentation

Convolutional neural networks (CNN) have become the predominant model fo...
research
07/17/2018

Invariant Information Distillation for Unsupervised Image Segmentation and Clustering

We present a new method that learns to segment and cluster images withou...

Please sign up or login with your details

Forgot password? Click here to reset