Domain Adaptive Scene Text Detection via Subcategorization

12/01/2022
by   Zichen Tian, et al.
0

Most existing scene text detectors require large-scale training data which cannot scale well due to two major factors: 1) scene text images often have domain-specific distributions; 2) collecting large-scale annotated scene text images is laborious. We study domain adaptive scene text detection, a largely neglected yet very meaningful task that aims for optimal transfer of labelled scene text images while handling unlabelled images in various new domains. Specifically, we design SCAST, a subcategory-aware self-training technique that mitigates the network overfitting and noisy pseudo labels in domain adaptive scene text detection effectively. SCAST consists of two novel designs. For labelled source data, it introduces pseudo subcategories for both foreground texts and background stuff which helps train more generalizable source models with multi-class detection objectives. For unlabelled target data, it mitigates the network overfitting by co-regularizing the binary and subcategory classifiers trained in the source domain. Extensive experiments show that SCAST achieves superior detection performance consistently across multiple public benchmarks, and it also generalizes well to other domain adaptive detection tasks such as vehicle detection.

READ FULL TEXT

page 7

page 8

research
09/03/2020

Synthetic-to-Real Unsupervised Domain Adaptation for Scene Text Detection in the Wild

Deep learning-based scene text detection can achieve preferable performa...
research
05/23/2020

Self-Training for Domain Adaptive Scene Text Detection

Though deep learning based scene text detection has achieved great progr...
research
07/09/2018

Verisimilar Image Synthesis for Accurate Detection and Recognition of Texts in Scenes

The requirement of large amounts of annotated images has become one gran...
research
03/18/2020

SwapText: Image Based Texts Transfer in Scenes

Swapping text in scene images while preserving original fonts, colors, s...
research
07/23/2022

Progressive Scene Text Erasing with Self-Supervision

Scene text erasing seeks to erase text contents from scene images and cu...
research
06/30/2022

Hierarchical Mask Calibration for Unified Domain Adaptive Panoptic Segmentation

Domain adaptive panoptic segmentation aims to mitigate data annotation c...
research
01/26/2019

Scene Text Synthesis for Efficient and Effective Deep Network Training

A large amount of annotated training images is critical for training acc...

Please sign up or login with your details

Forgot password? Click here to reset