Analyzing and Interpreting Convolutional Neural Networks in NLP

10/18/2018
by   Mahnaz Koupaee, et al.
0

Convolutional neural networks have been successfully applied to various NLP tasks. However, it is not obvious whether they model different linguistic patterns such as negation, intensification, and clause compositionality to help the decision-making process. In this paper, we apply visualization techniques to observe how the model can capture different linguistic features and how these features can affect the performance of the model. Later on, we try to identify the model errors and their sources. We believe that interpreting CNNs is the first step to understand the underlying semantic features which can raise awareness to further improve the performance and explainability of CNN models.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2018

What Does a TextCNN Learn?

TextCNN, the convolutional neural network for text, is a useful deep lea...
research
06/22/2018

Visualizing and Understanding Deep Neural Networks in CTR Prediction

Although deep learning techniques have been successfully applied to many...
research
11/13/2017

Learning and Visualizing Localized Geometric Features Using 3D-CNN: An Application to Manufacturability Analysis of Drilled Holes

3D Convolutional Neural Networks (3D-CNN) have been used for object reco...
research
12/15/2021

Decomposing Natural Logic Inferences in Neural NLI

In the interest of interpreting neural NLI models and their reasoning st...
research
07/12/2018

Recurrent Neural Networks in Linguistic Theory: Revisiting Pinker and Prince (1988) and the Past Tense Debate

Can advances in NLP help advance cognitive modeling? We examine the role...
research
04/13/2021

A Tale of Two Lexica Testing Computational Hypotheses with Deep Convolutional Neural Networks

Gow's (2012) dual lexicon model suggests that the primary purpose of wor...

Please sign up or login with your details

Forgot password? Click here to reset