Improving Attention-Based Handwritten Mathematical Expression Recognition with Scale Augmentation and Drop Attention

07/20/2020
by   Zhe Li, et al.
0

Handwritten mathematical expression recognition (HMER) is an important research direction in handwriting recognition. The performance of HMER suffers from the two-dimensional structure of mathematical expressions (MEs). To address this issue, in this paper, we propose a high-performance HMER model with scale augmentation and drop attention. Specifically, tackling ME with unstable scale in both horizontal and vertical directions, scale augmentation improves the performance of the model on MEs of various scales. An attention-based encoder-decoder network is used for extracting features and generating predictions. In addition, drop attention is proposed to further improve performance when the attention distribution of the decoder is not precise. Compared with previous methods, our method achieves state-of-the-art performance on two public datasets of CROHME 2014 and CROHME 2016.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/05/2018

Multi-Scale Attention with Dense Encoder for Handwritten Mathematical Expression Recognition

Handwritten mathematical expression recognition is a challenging problem...
research
05/06/2021

Handwritten Mathematical Expression Recognition with Bidirectionally Trained Transformer

Encoder-decoder models have made great progress on handwritten mathemati...
research
06/28/2023

DenseBAM-GI: Attention Augmented DeneseNet with momentum aided GRU for HMER

The task of recognising Handwritten Mathematical Expressions (HMER) is c...
research
12/07/2021

Handwritten Mathematical Expression Recognition via Attention Aggregation based Bi-directional Mutual Learning

Handwritten mathematical expression recognition aims to automatically ge...
research
09/16/2016

Image-to-Markup Generation with Coarse-to-Fine Attention

We present a neural encoder-decoder model to convert images into present...
research
07/10/2022

CoMER: Modeling Coverage for Transformer-based Handwritten Mathematical Expression Recognition

The Transformer-based encoder-decoder architecture has recently made sig...
research
01/21/2019

Pattern Generation Strategies for Improving Recognition of Handwritten Mathematical Expressions

Recognition of Handwritten Mathematical Expressions (HMEs) is a challeng...

Please sign up or login with your details

Forgot password? Click here to reset