Neural Networks as Explicit Word-Based Rules

07/10/2019
by   Jindřich Libovický, et al.
0

Filters of convolutional networks used in computer vision are often visualized as image patches that maximize the response of the filter. We use the same approach to interpret weight matrices in simple architectures for natural language processing tasks. We interpret a convolutional network for sentiment classification as word-based rules. Using the rule, we recover the performance of the original model.

READ FULL TEXT

page 1

page 2

page 3

research
12/22/2021

An Attention Score Based Attacker for Black-box NLP Classifier

Deep neural networks have a wide range of applications in solving variou...
research
05/22/2017

Convolutional Networks with MuxOut Layers as Multi-rate Systems for Image Upscaling

We interpret convolutional networks as adaptive filters and combine them...
research
12/15/2020

Rule Extraction from Binary Neural Networks with Convolutional Rules for Model Validation

Most deep neural networks are considered to be black boxes, meaning thei...
research
02/18/2019

Discovery of Natural Language Concepts in Individual Units of CNNs

Although deep convolutional networks have achieved improved performance ...
research
02/21/2022

Rethinking the Zigzag Flattening for Image Reading

Sequence ordering of word vector matters a lot to text reading, which ha...
research
02/07/2018

Learning One Convolutional Layer with Overlapping Patches

We give the first provably efficient algorithm for learning a one hidden...
research
09/23/2019

Learning in the Machine: To Share or Not to Share?

Weight-sharing is one of the pillars behind Convolutional Neural Network...

Please sign up or login with your details

Forgot password? Click here to reset