Dilated Continuous Random Field for Semantic Segmentation

02/01/2022
by   Xi Mo, et al.
0

Mean field approximation methodology has laid the foundation of modern Continuous Random Field (CRF) based solutions for the refinement of semantic segmentation. In this paper, we propose to relax the hard constraint of mean field approximation - minimizing the energy term of each node from probabilistic graphical model, by a global optimization with the proposed dilated sparse convolution module (DSConv). In addition, adaptive global average-pooling and adaptive global max-pooling are implemented as replacements of fully connected layers. In order to integrate DSConv, we design an end-to-end, time-efficient DilatedCRF pipeline. The unary energy term is derived either from pre-softmax and post-softmax features, or the predicted affordance map using a conventional classifier, making it easier to implement DilatedCRF for varieties of classifiers. We also present superior experimental results of proposed approach on the suction dataset comparing to other CRF-based approaches.

READ FULL TEXT

page 1

page 2

page 6

research
11/08/2018

An End-to-end Approach to Semantic Segmentation with 3D CNN and Posterior-CRF in Medical Images

Fully-connected Conditional Random Field (CRF) is often used as post-pro...
research
09/13/2018

Efficient Graph Cut Optimization for Full CRFs with Quantized Edges

Fully connected pairwise Conditional Random Fields (Full-CRF) with Gauss...
research
05/29/2022

Mean Field inference of CRFs based on GAT

In this paper we propose an improved mean-field inference algorithm for ...
research
05/21/2017

Incorporating Depth into both CNN and CRF for Indoor Semantic Segmentation

To improve segmentation performance, a novel neural network architecture...
research
10/27/2021

Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyond

We introduce regularized Frank-Wolfe, a general and effective algorithm ...
research
06/23/2016

Deep Learning Markov Random Field for Semantic Segmentation

Semantic segmentation tasks can be well modeled by Markov Random Field (...
research
04/01/2016

Variational reaction-diffusion systems for semantic segmentation

A novel global energy model for multi-class semantic image segmentation ...

Please sign up or login with your details

Forgot password? Click here to reset