Stroke-Based Scene Text Erasing Using Synthetic Data

04/23/2021
by   Zhengmi Tang, et al.
0

Scene text erasing, which replaces text regions with reasonable content in natural images, has drawn attention in the computer vision community in recent years. There are two potential subtasks in scene text erasing: text detection and image inpainting. Either sub-task requires considerable data to achieve better performance; however, the lack of a large-scale real-world scene-text removal dataset allows the existing methods to not work in full strength. To avoid the limitation of the lack of pairwise real-world data, we enhance and make full use of the synthetic text and consequently train our model only on the dataset generated by the improved synthetic text engine. Our proposed network contains a stroke mask prediction module and background inpainting module that can extract the text stroke as a relatively small hole from the text image patch to maintain more background content for better inpainting results. This model can partially erase text instances in a scene image with a bounding box provided or work with an existing scene text detector for automatic scene text erasing. The experimental results of qualitative evaluation and quantitative evaluation on the SCUT-Syn, ICDAR2013, and SCUT-EnsText datasets demonstrate that our method significantly outperforms existing state-of-the-art methods even when trained on real-world data.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 3

page 5

page 6

page 7

page 8

page 10

page 11

04/22/2016

Synthetic Data for Text Localisation in Natural Images

In this paper we introduce a new method for text detection in natural im...
11/19/2020

Scene text removal via cascaded text stroke detection and erasing

Recent learning-based approaches show promising performance improvement ...
03/11/2019

MTRNet: A Generic Scene Text Eraser

Text removal algorithms have been proposed for uni-lingual scripts with ...
08/08/2019

Editing Text in the Wild

In this paper, we are interested in editing text in natural images, whic...
12/16/2019

MTRNet++: One-stage Mask-based Scene Text Eraser

A precise, controllable, interpretable and easily trainable text removal...
05/08/2017

Scene Text Eraser

The character information in natural scene images contains various perso...
10/15/2020

A Human Eye-based Text Color Scheme Generation Method for Image Synthesis

Synthetic data used for scene text detection and recognition tasks have ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.