Stochastic Channel Decorrelation Network and Its Application to Visual Tracking

07/03/2018
by   Jie Guo, et al.
0

Deep convolutional neural networks (CNNs) have dominated many computer vision domains because of their great power to extract good features automatically. However, many deep CNNs-based computer vison tasks suffer from lack of train-ing data while there are millions of parameters in the deep models. Obviously, these two biphase violation facts will re-sult in parameter redundancy of many poorly designed deep CNNs. Therefore, we look deep into the existing CNNs and find that the redundancy of network parameters comes from the correlation between features in different channels within a convolutional layer. To solve this problem, we propose the stochastic channel decorrelation (SCD) block which, in every iteration, randomly selects multiple pairs of channels within a convolutional layer and calculates their normalized cross cor-relation (NCC). Then a squared max-margin loss is proposed as the objective of SCD to suppress correlation and keep di-versity between channels explicitly. The proposed SCD is very flexible and can be applied to any current existing CNN models simply. Based on the SCD and the Fully-Convolutional Siamese Networks, we proposed a visual tracking algorithm to verify the effectiveness of SCD.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/26/2019

LinearConv: Regenerating Redundancy in Convolution Filters as Linear Combinations for Parameter Reduction

Convolutional Neural Networks (CNNs) show state-of-the-art performance i...
research
10/18/2021

Channel redundancy and overlap in convolutional neural networks with channel-wise NNK graphs

Feature spaces in the deep layers of convolutional neural networks (CNNs...
research
11/17/2016

Factorized Bilinear Models for Image Recognition

Although Deep Convolutional Neural Networks (CNNs) have liberated their ...
research
03/06/2023

Testing the Channels of Convolutional Neural Networks

Neural networks have complex structures, and thus it is hard to understa...
research
04/06/2020

Efficient Scale Estimation Methods using Lightweight Deep Convolutional Neural Networks for Visual Tracking

In recent years, visual tracking methods that are based on discriminativ...
research
12/20/2020

Color Channel Perturbation Attacks for Fooling Convolutional Neural Networks and A Defense Against Such Attacks

The Convolutional Neural Networks (CNNs) have emerged as a very powerful...
research
07/28/2018

PROPEL: Probabilistic Parametric Regression Loss for Convolutional Neural Networks

Recently, Convolutional Neural Networks (CNNs) have dominated the field ...

Please sign up or login with your details

Forgot password? Click here to reset