Attention based Writer Independent Handwriting Verification

09/07/2020
by   Mohammad Abuzar Shaikh, et al.
1

The task of writer verification is to provide a likelihood score for whether the queried and known handwritten image samples belong to the same writer or not. Such a task calls for the neural network to make it's outcome interpretable, i.e. provide a view into the network's decision making process. We implement and integrate cross-attention and soft-attention mechanisms to capture the highly correlated and salient points in feature space of 2D inputs. The attention maps serve as an explanation premise for the network's output likelihood score. The attention mechanism also allows the network to focus more on relevant areas of the input, thus improving the classification performance. Our proposed approach achieves a precision of 86% for detecting intra-writer cases in CEDAR cursive "AND" dataset. Furthermore, we generate meaningful explanations for the provided decision by extracting attention maps from multiple levels of the network.

READ FULL TEXT

page 5

page 6

research
05/05/2021

Soft-Attention Improves Skin Cancer Classification Performance

In clinical applications, neural networks must focus on and highlight th...
research
05/03/2021

LFI-CAM: Learning Feature Importance for Better Visual Explanation

Class Activation Mapping (CAM) is a powerful technique used to understan...
research
01/18/2023

TAME: Attention Mechanism Based Feature Fusion for Generating Explanation Maps of Convolutional Neural Networks

The apparent “black box” nature of neural networks is a barrier to adopt...
research
11/09/2022

Automated MRI Field of View Prescription from Region of Interest Prediction by Intra-stack Attention Neural Network

Manual prescription of the field of view (FOV) by MRI technologists is v...
research
02/17/2019

Attention-Based Prototypical Learning Towards Interpretable, Confident and Robust Deep Neural Networks

We propose a new framework for prototypical learning that bases decision...
research
06/29/2021

Attention Aware Wavelet-based Detection of Morphed Face Images

Morphed images have exploited loopholes in the face recognition checkpoi...
research
04/24/2020

A Concept-based Abstraction-Aggregation Deep Neural Network for Interpretable Document Classification

Using attention weights to identify information that is important for mo...

Please sign up or login with your details

Forgot password? Click here to reset