Don't ignore Dropout in Fully Convolutional Networks

08/24/2019
by   Thomas Spilsbury, et al.
26

Data for Image segmentation models can be costly to obtain due to the precision required by human annotators. We run a series of experiments showing the effect of different kinds of Dropout training on the DeepLabv3+ Image segmentation model when trained using a small dataset. We find that when appropriate forms of Dropout are applied in the right place in the model architecture that non-insignificant improvement in Mean Intersection over Union (mIoU) score can be observed. In our best case, we find that applying Dropout scheduling in conjunction with SpatialDropout improves baseline mIoU from 0.49 to 0.59. This result shows that even where a model architecture makes extensive use of Batch Normalization, Dropout can still be an effective way of improving performance in low data situations.

READ FULL TEXT

page 7

page 8

page 9

page 10

page 11

page 12

page 13

page 14

research
10/30/2018

DropBlock: A regularization method for convolutional networks

Deep neural networks often work well when they are over-parameterized an...
research
04/15/2016

High-performance Semantic Segmentation Using Very Deep Fully Convolutional Networks

We propose a method for high-performance semantic image segmentation (or...
research
07/08/2016

Adjusting for Dropout Variance in Batch Normalization and Weight Initialization

We show how to adjust for the variance introduced by dropout with correc...
research
02/13/2023

How to Use Dropout Correctly on Residual Networks with Batch Normalization

For the stable optimization of deep neural networks, regularization meth...
research
02/28/2020

The Implicit and Explicit Regularization Effects of Dropout

Dropout is a widely-used regularization technique, often required to obt...
research
07/27/2023

R-Block: Regularized Block of Dropout for convolutional networks

Dropout as a regularization technique is widely used in fully connected ...
research
05/23/2018

Pushing the bounds of dropout

We show that dropout training is best understood as performing MAP estim...

Please sign up or login with your details

Forgot password? Click here to reset