DeepAI
Log In Sign Up

ERIC: Extracting Relations Inferred from Convolutions

10/19/2020
by   Joe Townsend, et al.
0

Our main contribution is to show that the behaviour of kernels across multiple layers of a convolutional neural network can be approximated using a logic program. The extracted logic programs yield accuracies that correlate with those of the original model, though with some information loss in particular as approximations of multiple layers are chained together or as lower layers are quantised. We also show that an extracted program can be used as a framework for further understanding the behaviour of CNNs. Specifically, it can be used to identify key kernels worthy of deeper inspection and also identify relationships with other kernels in the form of the logical rules. Finally, we make a preliminary, qualitative assessment of rules we extract from the last convolutional layer and show that kernels identified are symbolic in that they react strongly to sets of similar images that effectively divide output classes into sub-classes with distinct characteristics.

READ FULL TEXT

page 12

page 13

06/14/2021

pix2rule: End-to-end Neuro-symbolic Rule Learning

Humans have the ability to seamlessly combine low-level visual input wit...
10/12/2011

Discovering Classes of Strongly Equivalent Logic Programs

In this paper we apply computer-aided theorem discovery technique to dis...
05/23/2018

Use of symmetric kernels for convolutional neural networks

At this work we introduce horizontally symmetric convolutional kernels f...
02/07/2020

Learning Class Regularized Features for Action Recognition

Training Deep Convolutional Neural Networks (CNNs) is based on the notio...
12/09/2019

Naive Gabor Networks

In this paper, we introduce naive Gabor Networks or Gabor-Nets which, fo...