Rethinking Text Segmentation: A Novel Dataset and A Text-Specific Refinement Approach

11/27/2020
by   Xingqian Xu, et al.
0

Text segmentation is a prerequisite in many real-world text-related tasks, e.g., text style transfer, and scene text removal. However, facing the lack of high-quality datasets and dedicated investigations, this critical prerequisite has been left as an assumption in many works, and has been largely overlooked by current research. To bridge this gap, we proposed TextSeg, a large-scale fine-annotated text dataset with six types of annotations: word- and character-wise bounding polygons, masks and transcriptions. We also introduce Text Refinement Network (TexRNet), a novel text segmentation approach that adapts to the unique properties of text, e.g. non-convex boundary, diverse texture, etc., which often impose burdens on traditional segmentation models. In our TexRNet, we propose text specific network designs to address such challenges, including key features pooling and attention-based similarity checking. We also introduce trimap and discriminator losses that show significant improvement on text segmentation. Extensive experiments are carried out on both our TextSeg dataset and other existing datasets. We demonstrate that TexRNet consistently improves text segmentation performance by nearly 2 compared to other state-of-the-art segmentation methods. Our dataset and code will be made available at https://github.com/SHI-Labs/Rethinking-Text-Segmentation.

READ FULL TEXT

page 1

page 2

page 7

page 8

page 11

page 13

page 14

page 15

research
06/16/2023

FETNet: Feature Erasing and Transferring Network for Scene Text Removal

The scene text removal (STR) task aims to remove text regions and recove...
research
03/31/2021

Deep Image Harmonization by Bridging the Reality Gap

Image harmonization has been significantly advanced with large-scale har...
research
10/28/2017

Total-Text: A Comprehensive Dataset for Scene Text Detection and Recognition

Text in curve orientation, despite being one of the common text orientat...
research
06/28/2023

Effective Transfer of Pretrained Large Visual Model for Fabric Defect Segmentation via Specifc Knowledge Injection

Fabric defect segmentation is integral to textile quality control. Despi...
research
07/03/2022

Trichomonas Vaginalis Segmentation in Microscope Images

Trichomoniasis is a common infectious disease with high incidence caused...
research
08/25/2023

Self-supervised Scene Text Segmentation with Object-centric Layered Representations Augmented by Text Regions

Text segmentation tasks have a very wide range of application values, su...
research
10/15/2019

DeepErase: Weakly Supervised Ink Artifact Removal in Document Text Images

Paper-intensive industries like insurance, law, and government have long...

Please sign up or login with your details

Forgot password? Click here to reset