Understanding Intra-Class Knowledge Inside CNN

07/09/2015
by   Donglai Wei, et al.
0

Convolutional Neural Network (CNN) has been successful in image recognition tasks, and recent works shed lights on how CNN separates different classes with the learned inter-class knowledge through visualization. In this work, we instead visualize the intra-class knowledge inside CNN to better understand how an object class is represented in the fully-connected layers. To invert the intra-class knowledge into more interpretable images, we propose a non-parametric patch prior upon previous CNN visualization models. With it, we show how different "styles" of templates for an object class are organized by CNN in terms of location and content, and represented in a hierarchical and ensemble way. Moreover, such intra-class knowledge can be used in many interesting applications, e.g. style-based image retrieval and style-based object completion.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
10/14/2019

Encoder-Decoder based CNN and Fully Connected CRFs for Remote Sensed Image Segmentation

With the advancement of remote-sensed imaging large volumes of very high...
research
05/05/2021

RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognition

We propose RepMLP, a multi-layer-perceptron-style neural network buildin...
research
07/15/2020

Decoding CNN based Object Classifier Using Visualization

This paper investigates how working of Convolutional Neural Network (CNN...
research
05/23/2016

Mask-CNN: Localizing Parts and Selecting Descriptors for Fine-Grained Image Recognition

Fine-grained image recognition is a challenging computer vision problem,...
research
01/25/2023

Variation-Aware Semantic Image Synthesis

Semantic image synthesis (SIS) aims to produce photorealistic images ali...
research
07/27/2021

Probing neural networks with t-SNE, class-specific projections and a guided tour

We use graphical methods to probe neural nets that classify images. Plot...

Please sign up or login with your details

Forgot password? Click here to reset