Superpixel Sampling Networks

07/26/2018
by   Varun Jampani, et al.
6

Superpixels provide an efficient low/mid-level representation of image data, which greatly reduces the number of image primitives for subsequent vision tasks. Existing superpixel algorithms are not differentiable, making them difficult to integrate into otherwise end-to-end trainable deep neural networks. We develop a new differentiable model for superpixel sampling that leverages deep networks for learning superpixel segmentation. The resulting "Superpixel Sampling Network" (SSN) is end-to-end trainable, which allows learning task-specific superpixels with flexible loss functions and has fast runtime. Extensive experimental analysis indicates that SSNs not only outperform existing superpixel algorithms on traditional segmentation benchmarks, but can also learn superpixels for other tasks. In addition, SSNs can be easily integrated into downstream deep networks resulting in performance improvements.

READ FULL TEXT

page 13

page 20

page 21

research
10/17/2021

SIN:Superpixel Interpolation Network

Superpixels have been widely used in computer vision tasks due to their ...
research
04/28/2023

Differentiable Sensor Layouts for End-to-End Learning of Task-Specific Camera Parameters

The success of deep learning is frequently described as the ability to t...
research
01/16/2021

DeepMI: A Mutual Information Based Framework For Unsupervised Deep Learning of Tasks

In this work, we propose an information theory based framework DeepMI to...
research
01/29/2019

Differentiable Subset Sampling

Many machine learning tasks require sampling a subset of items from a co...
research
10/11/2021

Learning with Algorithmic Supervision via Continuous Relaxations

The integration of algorithmic components into neural architectures has ...
research
01/31/2018

Optimizing Non-decomposable Measures with Deep Networks

We present a class of algorithms capable of directly training deep neura...
research
09/05/2023

DeNISE: Deep Networks for Improved Segmentation Edges

This paper presents Deep Networks for Improved Segmentation Edges (DeNIS...

Please sign up or login with your details

Forgot password? Click here to reset