End-to-end semantic face segmentation with conditional random fields as convolutional, recurrent and adversarial networks

03/09/2017
by   Umut Güçlü, et al.
0

Recent years have seen a sharp increase in the number of related yet distinct advances in semantic segmentation. Here, we tackle this problem by leveraging the respective strengths of these advances. That is, we formulate a conditional random field over a four-connected graph as end-to-end trainable convolutional and recurrent networks, and estimate them via an adversarial process. Importantly, our model learns not only unary potentials but also pairwise potentials, while aggregating multi-scale contexts and controlling higher-order inconsistencies. We evaluate our model on two standard benchmark datasets for semantic face segmentation, achieving state-of-the-art results on both of them.

READ FULL TEXT

page 4

page 5

page 13

page 14

research
02/11/2015

Conditional Random Fields as Recurrent Neural Networks

Pixel-level labelling tasks, such as semantic segmentation, play a centr...
research
05/29/2018

Superpixel-enhanced Pairwise Conditional Random Field for Semantic Segmentation

Superpixel-based Higher-order Conditional Random Fields (CRFs) are effec...
research
01/24/2017

Learning Arbitrary Pairwise Potentials in CRFs for Semantic Segmentation

Are we using the right potential functions in the Conditional Random Fie...
research
04/05/2018

A Multi-Layer Approach to Superpixel-based Higher-order Conditional Random Field for Semantic Image Segmentation

Superpixel-based Higher-order Conditional random fields (SP-HO-CRFs) are...
research
11/28/2016

Deep, Dense, and Low-Rank Gaussian Conditional Random Fields

In this work we introduce a fully-connected graph structure in the Deep ...
research
04/27/2020

Can We Learn Heuristics For Graphical Model Inference Using Reinforcement Learning?

Combinatorial optimization is frequently used in computer vision. For in...
research
08/06/2017

End-to-end learning potentials for structured attribute prediction

We present a structured inference approach in deep neural networks for m...

Please sign up or login with your details

Forgot password? Click here to reset