Illegible Text to Readable Text: An Image-to-Image Transformation using Conditional Sliced Wasserstein Adversarial Networks

10/11/2019
by   Mostafa Karimi, et al.
0

Automatic text recognition from ancient handwritten record images is an important problem in the genealogy domain. However, critical challenges such as varying noise conditions, vanishing texts, and variations in handwriting make the recognition task difficult. We tackle this problem by developing a handwritten-to-machine-print conditional Generative Adversarial network (HW2MP-GAN) model that formulates handwritten recognition as a text-Image-to-text-Image translation problem where a given image, typically in an illegible form, is converted into another image, close to its machine-print form. The proposed model consists of three-components including a generator, and word-level and character-level discriminators. The model incorporates Sliced Wasserstein distance (SWD) and U-Net architectures in HW2MP-GAN for better quality image-to-image transformation. Our experiments reveal that HW2MP-GAN outperforms state-of-the-art baseline cGAN models by almost 30 in Frechet Handwritten Distance (FHD), 0.6 on average Levenshtein distance and 39 in word accuracy for image-to-image translation on IAM database. Further, HW2MP-GAN improves handwritten recognition word accuracy by 1.3 baseline handwritten recognition models on the IAM database.

READ FULL TEXT
research
05/27/2021

Efficient High-Resolution Image-to-Image Translation using Multi-Scale Gradient U-Net

Recently, Conditional Generative Adversarial Network (Conditional GAN) h...
research
03/01/2019

Adversarial Generation of Handwritten Text Images Conditioned on Sequences

State-of-the-art offline handwriting text recognition systems tend to us...
research
12/12/2019

Unified Generative Adversarial Networks for Controllable Image-to-Image Translation

Controllable image-to-image translation, i.e., transferring an image fro...
research
05/26/2021

Enhance to Read Better: An Improved Generative Adversarial Network for Handwritten Document Image Enhancement

Handwritten document images can be highly affected by degradation for di...
research
01/24/2022

Paired Image to Image Translation for Strikethrough Removal From Handwritten Words

Transcribing struck-through, handwritten words, for example for the purp...
research
01/21/2019

Generating Text Sequence Images for Recognition

Recently, methods based on deep learning have dominated the field of tex...
research
08/24/2022

Generative Adversarial Network (GAN) based Image-Deblurring

This thesis analyzes the challenging problem of Image Deblurring based o...

Please sign up or login with your details

Forgot password? Click here to reset