The Importance of Skip Connections in Biomedical Image Segmentation

08/14/2016
by   Michal Drozdzal, et al.
0

In this paper, we study the influence of both long and short skip connections on Fully Convolutional Networks (FCN) for biomedical image segmentation. In standard FCNs, only long skip connections are used to skip features from the contracting path to the expanding path in order to recover spatial information lost during downsampling. We extend FCNs by adding short skip connections, that are similar to the ones introduced in residual networks, in order to build very deep FCNs (of hundreds of layers). A review of the gradient flow confirms that for a very deep FCN it is beneficial to have both long and short skip connections. Finally, we show that a very deep FCN can achieve near-to-state-of-the-art results on the EM dataset without any further post-processing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/17/2018

LadderNet: Multi-path networks based on U-Net for medical image segmentation

U-Net has been providing state-of-the-art performance in many medical im...
research
07/18/2017

Beyond Forward Shortcuts: Fully Convolutional Master-Slave Networks (MSNets) with Backward Skip Connections for Semantic Segmentation

Recent deep CNNs contain forward shortcut connections; i.e. skip connect...
research
07/20/2018

Competition vs. Concatenation in Skip Connections of Fully Convolutional Networks

Increased information sharing through short and long-range skip connecti...
research
09/04/2018

Deep Smoke Segmentation

Inspired by the recent success of fully convolutional networks (FCN) in ...
research
01/20/2019

Visualized Insights into the Optimization Landscape of Fully Convolutional Networks

Many image processing tasks involve image-to-image mapping, which can be...
research
10/23/2018

Analysis of Atomistic Representations Using Weighted Skip-Connections

In this work, we extend the SchNet architecture by using weighted skip c...
research
11/03/2022

Translated Skip Connections – Expanding the Receptive Fields of Fully Convolutional Neural Networks

The effective receptive field of a fully convolutional neural network is...

Please sign up or login with your details

Forgot password? Click here to reset