Foreground Segmentation Using a Triplet Convolutional Neural Network for Multiscale Feature Encoding

01/07/2018
by   Long Ang Lim, et al.
0

A common approach for moving objects segmentation in a scene is to perform a background subtraction. Several methods have been proposed in this domain. However, they lack the ability of handling various difficult scenarios such as illumination changes, background or camera motion, camouflage effect, shadow etc. To address these issues, we propose a robust and flexible encoder-decoder type neural network based approach. We adapt a pre-trained convolutional network, i.e. VGG-16 Net, under a triplet framework in the encoder part to embed an image in multiple scales into the feature space and use a transposed convolutional network in the decoder part to learn a mapping from feature space to image space. We train this network end-to-end by using only a few training samples. Our network takes an RGB image in three different scales and produces a foreground segmentation probability mask for the corresponding image. In order to evaluate our model, we entered the Change Detection 2014 Challenge (changedetection.net) and our method outperformed all the existing state-of-the-art methods by an average F-Measure of 0.9770. Our source code will be made publicly available at https://github.com/lim-anggun/FgSegNet.

READ FULL TEXT

page 3

page 10

page 11

page 12

research
08/04/2018

Learning Multi-scale Features for Foreground Segmentation

Foreground segmentation algorithms aim segmenting moving objects from th...
research
06/01/2020

Foreground-aware Semantic Representations for Image Harmonization

Image harmonization is an important step in photo editing to achieve vis...
research
06/03/2018

TernausNetV2: Fully Convolutional Network for Instance Segmentation

The most common approaches to instance segmentation are complex and use ...
research
07/24/2017

Joint Background Reconstruction and Foreground Segmentation via A Two-stage Convolutional Neural Network

Foreground segmentation in video sequences is a classic topic in compute...
research
09/16/2022

A Deep Moving-camera Background Model

In video analysis, background models have many applications such as back...
research
03/16/2020

Synthesizing human-like sketches from natural images using a conditional convolutional decoder

Humans are able to precisely communicate diverse concepts by employing s...
research
02/06/2021

Sill-Net: Feature Augmentation with Separated Illumination Representation

For visual object recognition tasks, the illumination variations can cau...

Please sign up or login with your details

Forgot password? Click here to reset