UnrealText: Synthesizing Realistic Scene Text Images from the Unreal World

03/24/2020
by   Shangbang Long, et al.
6

Synthetic data has been a critical tool for training scene text detection and recognition models. On the one hand, synthetic word images have proven to be a successful substitute for real images in training scene text recognizers. On the other hand, however, scene text detectors still heavily rely on a large amount of manually annotated real-world images, which are expensive. In this paper, we introduce UnrealText, an efficient image synthesis method that renders realistic images via a 3D graphics engine. 3D synthetic engine provides realistic appearance by rendering scene and text as a whole, and allows for better text region proposals with access to precise scene information, e.g. normal and even object meshes. The comprehensive experiments verify its effectiveness on both scene text detection and recognition. We also generate a multilingual version for future research into multilingual scene text detection and recognition. The code and the generated datasets are released at: https://github.com/Jyouhou/UnrealText/ .

READ FULL TEXT

page 1

page 4

page 5

research
07/13/2019

SynthText3D: Synthesizing Scene Text Images from 3D Virtual Worlds

With the development of deep neural networks, the demand for a significa...
research
07/20/2021

SynthTIGER: Synthetic Text Image GEneratoR Towards Better Text Recognition Models

For successful scene text recognition (STR) models, synthetic text image...
research
09/06/2022

A Scene-Text Synthesis Engine Achieved Through Learning from Decomposed Real-World Data

Scene-text image synthesis techniques aimed at naturally composing text ...
research
03/15/2023

Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs

Image synthesis driven by computer graphics achieved recently a remarkab...
research
07/23/2022

Progressive Scene Text Erasing with Self-Supervision

Scene text erasing seeks to erase text contents from scene images and cu...
research
04/10/2016

TextProposals: a Text-specific Selective Search Algorithm for Word Spotting in the Wild

Motivated by the success of powerful while expensive techniques to recog...
research
11/28/2014

On Rendering Synthetic Images for Training an Object Detector

We propose a novel approach to synthesizing images that are effective fo...

Please sign up or login with your details

Forgot password? Click here to reset