Deeply-Fused Nets

05/25/2016
by   Jingdong Wang, et al.
0

In this paper, we present a novel deep learning approach, deeply-fused nets. The central idea of our approach is deep fusion, i.e., combine the intermediate representations of base networks, where the fused output serves as the input of the remaining part of each base network, and perform such combinations deeply over several intermediate representations. The resulting deeply fused net enjoys several benefits. First, it is able to learn multi-scale representations as it enjoys the benefits of more base networks, which could form the same fused network, other than the initial group of base networks. Second, in our suggested fused net formed by one deep and one shallow base networks, the flows of the information from the earlier intermediate layer of the deep base network to the output and from the input to the later intermediate layer of the deep base network are both improved. Last, the deep and shallow base networks are jointly learnt and can benefit from each other. More interestingly, the essential depth of a fused net composed from a deep base network and a shallow base network is reduced because the fused net could be composed from a less deep base network, and thus training the fused net is less difficult than training the initial deep base network. Empirical results demonstrate that our approach achieves superior performance over two closely-related methods, ResNet and Highway, and competitive performance compared to the state-of-the-arts.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/06/2018

Infrared and visible image fusion using a novel deep decomposition method

Infrared and visible image fusion is an important problem in image fusio...
research
03/30/2017

From Deep to Shallow: Transformations of Deep Rectifier Networks

In this paper, we introduce transformations of deep rectifier networks, ...
research
04/19/2018

Infrared and Visible Image Fusion using a Deep Learning Framework

In recent years, deep learning has become a very active research tool wh...
research
10/17/2020

Gradient Aware Cascade Network for Multi-Focus Image Fusion

The general aim of multi-focus image fusion is to gather focused regions...
research
07/05/2020

Alpha-Net: Architecture, Models, and Applications

Deep learning network training is usually computationally expensive and ...
research
05/27/2020

Automatic salt deposits segmentation: A deep learning approach

One of the most important applications of seismic reflection is the hydr...
research
07/28/2023

Recovering high-quality FODs from a reduced number of diffusion-weighted images using a model-driven deep learning architecture

Fibre orientation distribution (FOD) reconstruction using deep learning ...

Please sign up or login with your details

Forgot password? Click here to reset