Unsupervised Deep Learning Meets Chan-Vese Model

04/14/2022
by   Dihan Zheng, et al.
7

The Chan-Vese (CV) model is a classic region-based method in image segmentation. However, its piecewise constant assumption does not always hold for practical applications. Many improvements have been proposed but the issue is still far from well solved. In this work, we propose an unsupervised image segmentation approach that integrates the CV model with deep neural networks, which significantly improves the original CV model's segmentation accuracy. Our basic idea is to apply a deep neural network that maps the image into a latent space to alleviate the violation of the piecewise constant assumption in image space. We formulate this idea under the classic Bayesian framework by approximating the likelihood with an evidence lower bound (ELBO) term while keeping the prior term in the CV model. Thus, our model only needs the input image itself and does not require pre-training from external datasets. Moreover, we extend the idea to multi-phase case and dataset based unsupervised image segmentation. Extensive experiments validate the effectiveness of our model and show that the proposed method is noticeably better than other unsupervised segmentation approaches.

READ FULL TEXT

page 3

page 16

page 18

page 20

page 21

research
07/26/2018

Linkage between Piecewise Constant Mumford-Shah model and ROF model and its virtue in image segmentation

The piecewise constant Mumford-Shah (PCMS) model and the Rudin-Osher-Fat...
research
04/04/2019

Improved Inference via Deep Input Transfer

Although numerous improvements have been made in the field of image segm...
research
02/09/2018

Piecewise Flat Embedding for Image Segmentation

We propose a new nonlinear embedding -- Piecewise Flat Embedding (PFE) -...
research
01/11/2023

Inverse Quantum Fourier Transform Inspired Algorithm for Unsupervised Image Segmentation

Image segmentation is a very popular and important task in computer visi...
research
11/06/2018

Deep feature transfer between localization and segmentation tasks

In this paper, we propose a new pre-training scheme for U-net based imag...
research
01/22/2018

Edge-Preserving Piecewise Linear Image Smoothing Using Piecewise Constant Filters

Most image smoothing filters in the literature assume a piecewise consta...
research
06/25/2023

Interpretable Small Training Set Image Segmentation Network Originated from Multi-Grid Variational Model

The main objective of image segmentation is to divide an image into homo...

Please sign up or login with your details

Forgot password? Click here to reset