Broadcasting Convolutional Network

12/07/2017
by   Simyung Chang, et al.
0

While convolutional neural networks (CNNs) are widely used for handling spatio-temporal scenes, there exist limitations in reasoning relations among spatial features caused by their inherent structures, which have been issued consistently in many studies. In this paper, we propose Broadcasting Convolutional Networks (BCN) that allow global receptive fields to share spatial information. BCNs are simple network modules that collect effective spatial features, embed location informations and broadcast them to the entire feature maps without much additional computational cost. This method gains great improvements in feature localization problems through efficiently extending the receptive fields, and can easily be implemented within any structure of CNNs. We further utilize BCN to propose Multi-Relational Networks (multiRN) that greatly improve existing Relation Networks (RNs). In pixel-based relation reasoning problems, multiRN with BCNs implanted extends the concept of `pairwise relations' from conventional RNs to `multiple relations' by relating each object with multiple objects at once and not in pairs. This yields in O(n) complexity for n number of objects, which is a vast computational gain from RNs that take O(n^2). Through experiments, BCNs are proven for their usability on relation reasoning problems, which is due from their efficient handlings of spatial information.

READ FULL TEXT

page 2

page 5

page 8

page 13

page 14

page 15

research
04/11/2019

A Relation-Augmented Fully Convolutional Network for Semantic Segmentationin Aerial Scenes

Most current semantic segmentation approaches fall back on deep convolut...
research
04/11/2019

A Relation-Augmented Fully Convolutional Network for Semantic Segmentation in Aerial Scenes

Most current semantic segmentation approaches fall back on deep convolut...
research
08/08/2021

Understanding the computational demands underlying visual reasoning

Visual understanding requires comprehending complex visual relations bet...
research
05/16/2023

Content-Adaptive Downsampling in Convolutional Neural Networks

Many convolutional neural networks (CNNs) rely on progressive downsampli...
research
11/30/2018

Graph-Based Global Reasoning Networks

Globally modeling and reasoning over relations between regions can be be...
research
11/05/2018

Multi-layer Relation Networks

Relational Networks (RN) as introduced by Santoro et al. (2017) have dem...
research
02/09/2018

Not-So-CLEVR: Visual Relations Strain Feedforward Neural Networks

The robust and efficient recognition of visual relations in images is a ...

Please sign up or login with your details

Forgot password? Click here to reset