Global and Local Features through Gaussian Mixture Models on Image Semantic Segmentation

07/19/2022
by   Darwin Saire, et al.
0

The semantic segmentation task aims at dense classification at the pixel-wise level. Deep models exhibited progress in tackling this task. However, one remaining problem with these approaches is the loss of spatial precision, often produced at the segmented objects' boundaries. Our proposed model addresses this problem by providing an internal structure for the feature representations while extracting a global representation that supports the former. To fit the internal structure, during training, we predict a Gaussian Mixture Model from the data, which, merged with the skip connections and the decoding stage, helps avoid wrong inductive biases. Furthermore, our results show that we can improve semantic segmentation by providing both learning representations (global and local) with a clustering behavior and combining them. Finally, we present results demonstrating our advances in Cityscapes and Synthia datasets.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 11

page 12

page 13

page 14

research
09/02/2009

Scale-Based Gaussian Coverings: Combining Intra and Inter Mixture Models in Image Segmentation

By a "covering" we mean a Gaussian mixture model fit to observed data. A...
research
10/05/2022

GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Models

Prevalent semantic segmentation solutions are, in essence, a dense discr...
research
02/23/2017

Analyzing Learned Convnet Features with Dirichlet Process Gaussian Mixture Models

Convolutional Neural Networks (Convnets) have achieved good results in a...
research
03/28/2016

Hierarchical Gaussian Mixture Model with Objects Attached to Terminal and Non-terminal Dendrogram Nodes

A hierarchical clustering algorithm based on Gaussian mixture model is p...
research
10/26/2022

Boosting Semi-Supervised Semantic Segmentation with Probabilistic Representations

Recent breakthroughs in semi-supervised semantic segmentation have been ...
research
03/11/2019

Generating superpixels using deep image representations

Superpixel algorithms are a common pre-processing step for computer visi...
research
04/12/2023

SuperpixelGraph: Semi-automatic generation of building footprint through semantic-sensitive superpixel and neural graph networks

Most urban applications necessitate building footprints in the form of c...

Please sign up or login with your details

Forgot password? Click here to reset