Log In Sign Up

ERIC: Extracting Relations Inferred from Convolutions

by   Joe Townsend, et al.

Our main contribution is to show that the behaviour of kernels across multiple layers of a convolutional neural network can be approximated using a logic program. The extracted logic programs yield accuracies that correlate with those of the original model, though with some information loss in particular as approximations of multiple layers are chained together or as lower layers are quantised. We also show that an extracted program can be used as a framework for further understanding the behaviour of CNNs. Specifically, it can be used to identify key kernels worthy of deeper inspection and also identify relationships with other kernels in the form of the logical rules. Finally, we make a preliminary, qualitative assessment of rules we extract from the last convolutional layer and show that kernels identified are symbolic in that they react strongly to sets of similar images that effectively divide output classes into sub-classes with distinct characteristics.


page 12

page 13


pix2rule: End-to-end Neuro-symbolic Rule Learning

Humans have the ability to seamlessly combine low-level visual input wit...

Discovering Classes of Strongly Equivalent Logic Programs

In this paper we apply computer-aided theorem discovery technique to dis...

Use of symmetric kernels for convolutional neural networks

At this work we introduce horizontally symmetric convolutional kernels f...

Learning Class Regularized Features for Action Recognition

Training Deep Convolutional Neural Networks (CNNs) is based on the notio...

Naive Gabor Networks

In this paper, we introduce naive Gabor Networks or Gabor-Nets which, fo...