A Multi-Layer Approach to Superpixel-based Higher-order Conditional Random Field for Semantic Image Segmentation

04/05/2018
by   Li Sulimowicz, et al.
0

Superpixel-based Higher-order Conditional random fields (SP-HO-CRFs) are known for their effectiveness in enforcing both short and long spatial contiguity for pixelwise labelling in computer vision. However, their higher-order potentials are usually too complex to learn and often incur a high computational cost in performing inference. We propose an new approximation approach to SP-HO-CRFs that resolves these problems. Our approach is a multi-layer CRF framework that inherits the simplicity from pairwise CRFs by formulating both the higher-order and pairwise cues into the same pairwise potentials in the first layer. Essentially, this approach provides accuracy enhancement on the basis of pairwise CRFs without training by reusing their pre-trained parameters and/or weights. The proposed multi-layer approach performs especially well in delineating the boundary details (boarders) of object categories such as "trees" and "bushes". Multiple sets of experiments conducted on dataset MSRC-21 and PASCAL VOC 2012 validate the effectiveness and efficiency of the proposed methods.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
05/29/2018

Superpixel-enhanced Pairwise Conditional Random Field for Semantic Segmentation

Superpixel-based Higher-order Conditional Random Fields (CRFs) are effec...
research
05/23/2018

Efficient Relaxations for Dense CRFs with Sparse Higher Order Potentials

Dense conditional random fields (CRFs) with Gaussian pairwise potentials...
research
04/27/2020

Can We Learn Heuristics For Graphical Model Inference Using Reinforcement Learning?

Combinatorial optimization is frequently used in computer vision. For in...
research
03/28/2015

CRF Learning with CNN Features for Image Segmentation

Conditional Random Rields (CRF) have been widely applied in image segmen...
research
03/09/2017

End-to-end semantic face segmentation with conditional random fields as convolutional, recurrent and adversarial networks

Recent years have seen a sharp increase in the number of related yet dis...
research
04/06/2017

Higher-Order Minimum Cost Lifted Multicuts for Motion Segmentation

Most state-of-the-art motion segmentation algorithms draw their potentia...
research
07/01/2015

Beyond Semantic Image Segmentation : Exploring Efficient Inference in Video

We explore the efficiency of the CRF inference module beyond image level...

Please sign up or login with your details

Forgot password? Click here to reset