Interpretation of ResNet by Visualization of Preferred Stimulus in Receptive Fields

by   Genta Kobayashi, et al.
University of Electro-Communications

One of the methods used in image recognition is the Deep Convolutional Neural Network (DCNN). DCNN is a model in which the expressive power of features is greatly improved by deepening the hidden layer of CNN. The architecture of CNNs is determined based on a model of the visual cortex of mammals. There is a model called Residual Network (ResNet) that has a skip connection. ResNet is an advanced model in terms of the learning method, but it has no biological viewpoint. In this research, we investigate the receptive fields of a ResNet on the classification task in ImageNet. We find that ResNet has orientation selective neurons and double opponent color neurons. In addition, we suggest that some inactive neurons in the first layer of ResNet effect for the classification task.


page 7

page 8

page 9


What are the Receptive, Effective Receptive, and Projective Fields of Neurons in Convolutional Neural Networks?

In this work, we explain in detail how receptive fields, effective recep...

Study of Residual Networks for Image Recognition

Deep neural networks demonstrate to have a high performance on image cla...

On the special role of class-selective neurons in early training

It is commonly observed that deep networks trained for classification ex...

Selective Kernel Networks

In standard Convolutional Neural Networks (CNNs), the receptive fields o...

Deep Learning in Random Neural Fields: Numerical Experiments via Neural Tangent Kernel

A biological neural network in the cortex forms a neural field. Neurons ...

Deep Residual Learning for Weakly-Supervised Relation Extraction

Deep residual learning (ResNet) is a new method for training very deep n...

ResNetX: a more disordered and deeper network architecture

Designing efficient network structures has always been the core content ...

Please sign up or login with your details

Forgot password? Click here to reset