Fused Text Recogniser and Deep Embeddings Improve Word Recognition and Retrieval

07/01/2020
by   Siddhant Bansal, et al.
20

Recognition and retrieval of textual content from the large document collections have been a powerful use case for the document image analysis community. Often the word is the basic unit for recognition as well as retrieval. Systems that rely only on the text recogniser (OCR) output are not robust enough in many situations, especially when the word recognition rates are poor, as in the case of historic documents or digital libraries. An alternative has been word spotting based methods that retrieve/match words based on a holistic representation of the word. In this paper, we fuse the noisy output of text recogniser with a deep embeddings representation derived out of the entire word. We use average and max fusion for improving the ranked results in the case of retrieval. We validate our methods on a collection of Hindi documents. We improve word recognition rate by 1.4 and retrieval by 11.13 in the mAP.

READ FULL TEXT
research
03/23/2017

Content-based similar document image retrieval using fusion of CNN features

Rapid increase of digitized document give birth to high demand of docume...
research
02/05/2020

Experiments with Different Indexing Techniques for Text Retrieval tasks on Gujarati Language using Bag of Words Approach

This paper presents results of various experiments carried out to improv...
research
07/11/2022

Topic-Grained Text Representation-based Model for Document Retrieval

Document retrieval enables users to find their required documents accura...
research
10/02/2021

Asking questions on handwritten document collections

This work addresses the problem of Question Answering (QA) on handwritte...
research
07/02/2009

Bounding the Probability of Error for High Precision Recognition

We consider models for which it is important, early in processing, to es...
research
10/27/2020

Improving Word Recognition using Multiple Hypotheses and Deep Embeddings

We propose a novel scheme for improving the word recognition accuracy us...
research
12/01/2019

Speeding up Word Mover's Distance and its variants via properties of distances between embeddings

The Word Mover's Distance (WMD) proposed in Kusner et al. [ICML,2015] is...

Please sign up or login with your details

Forgot password? Click here to reset