Translated Skip Connections – Expanding the Receptive Fields of Fully Convolutional Neural Networks

11/03/2022
by   Joshua Bruton, et al.
0

The effective receptive field of a fully convolutional neural network is an important consideration when designing an architecture, as it defines the portion of the input visible to each convolutional kernel. We propose a neural network module, extending traditional skip connections, called the translated skip connection. Translated skip connections geometrically increase the receptive field of an architecture with negligible impact on both the size of the parameter space and computational complexity. By embedding translated skip connections into a benchmark architecture, we demonstrate that our module matches or outperforms four other approaches to expanding the effective receptive fields of fully convolutional neural networks. We confirm this result across five contemporary image segmentation datasets from disparate domains, including the detection of COVID-19 infection, segmentation of aerial imagery, common object segmentation, and segmentation for self-driving cars.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/15/2017

Understanding the Effective Receptive Field in Deep Convolutional Neural Networks

We study characteristics of receptive fields of units in deep convolutio...
research
06/27/2019

Dealing with Topological Information within a Fully Convolutional Neural Network

A fully convolutional neural network has a receptive field of limited si...
research
08/14/2016

The Importance of Skip Connections in Biomedical Image Segmentation

In this paper, we study the influence of both long and short skip connec...
research
11/07/2019

Investigations of the Influences of a CNN's Receptive Field on Segmentation of Subnuclei of Bilateral Amygdalae

Segmentation of objects with various sizes is relatively less explored i...
research
12/21/2021

RC-Net: A Convolutional Neural Network for Retinal Vessel Segmentation

Over recent years, increasingly complex approaches based on sophisticate...
research
10/23/2019

Neural Ordinary Differential Equations for Semantic Segmentation of Individual Colon Glands

Automated medical image segmentation plays a key role in quantitative re...
research
08/31/2018

3D Segmentation with Exponential Logarithmic Loss for Highly Unbalanced Object Sizes

With the introduction of fully convolutional neural networks, deep learn...

Please sign up or login with your details

Forgot password? Click here to reset