Optimizing Edge Detection for Image Segmentation with Multicut Penalties

12/10/2021
by   Steffen Jung, et al.
28

The Minimum Cost Multicut Problem (MP) is a popular way for obtaining a graph decomposition by optimizing binary edge labels over edge costs. While the formulation of a MP from independently estimated costs per edge is highly flexible and intuitive, solving the MP is NP-hard and time-expensive. As a remedy, recent work proposed to predict edge probabilities with awareness to potential conflicts by incorporating cycle constraints in the prediction process. We argue that such formulation, while providing a first step towards end-to-end learnable edge weights, is suboptimal, since it is built upon a loose relaxation of the MP. We therefore propose an adaptive CRF that allows to progressively consider more violated constraints and, in consequence, to issue solutions with higher validity. Experiments on the BSDS500 benchmark for natural image segmentation as well as on electron microscopic recordings show that our approach yields more precise edge detection and image segmentation.

READ FULL TEXT

page 1

page 12

page 13

page 14

page 15

page 16

research
11/10/2015

Semantic Image Segmentation with Task-Specific Edge Detection Using CNNs and a Discriminatively Trained Domain Transform

Deep convolutional neural networks (CNNs) are the backbone of state-of-a...
research
10/13/2019

An Image Segmentation Model Based on a Variational Formulation

Starting from a variational formulation, we present a model for image se...
research
05/22/2019

End-to-End Learned Random Walker for Seeded Image Segmentation

We present an end-to-end learned algorithm for seeded segmentation. Our ...
research
12/23/2018

End-to-end Learning for Graph Decomposition

We propose a novel end-to-end trainable framework for the graph decompos...
research
01/13/2012

NegCut: Automatic Image Segmentation based on MRF-MAP

Solving the Maximum a Posteriori on Markov Random Field, MRF-MAP, is a p...
research
04/04/2022

Learning to solve Minimum Cost Multicuts efficiently using Edge-Weighted Graph Convolutional Neural Networks

The minimum cost multicut problem is the NP-hard/APX-hard combinatorial ...
research
05/16/2021

Uncertainty in Minimum Cost Multicuts for Image and Motion Segmentation

The minimum cost lifted multicut approach has proven practically good pe...

Please sign up or login with your details

Forgot password? Click here to reset