DeepAI
Log In Sign Up

Detection and Rectification of Arbitrary Shaped Scene Texts by using Text Keypoints and Links

03/01/2021
by   Chuhui Xue, et al.
0

Detection and recognition of scene texts of arbitrary shapes remain a grand challenge due to the super-rich text shape variation in text line orientations, lengths, curvatures, etc. This paper presents a mask-guided multi-task network that detects and rectifies scene texts of arbitrary shapes reliably. Three types of keypoints are detected which specify the centre line and so the shape of text instances accurately. In addition, four types of keypoint links are detected of which the horizontal links associate the detected keypoints of each text instance and the vertical links predict a pair of landmark points (for each keypoint) along the upper and lower text boundary, respectively. Scene texts can be located and rectified by linking up the associated landmark points (giving localization polygon boxes) and transforming the polygon boxes via thin plate spline, respectively. Extensive experiments over several public datasets show that the use of text keypoints is tolerant to the variation in text orientations, lengths, and curvatures, and it achieves superior scene text detection and rectification performance as compared with state-of-the-art methods.

READ FULL TEXT

page 3

page 6

page 7

page 11

page 18

page 20

page 22

01/09/2019

MSR: Multi-Scale Shape Regression for Scene Text Detection

State-of-the-art scene text detection techniques predict quadrilateral b...
05/15/2019

Arbitrary Shape Scene Text Detection with Adaptive Text Region Representation

Scene text detection attracts much attention in computer vision, because...
07/10/2018

Accurate Scene Text Detection through Border Semantics Awareness and Bootstrapping

This paper presents a scene text detection technique that exploits boots...
10/25/2021

TPSNet: Thin-Plate-Spline Representation for Arbitrary Shape Scene Text Detection

The research focus of scene text detection has shifted to arbitrary shap...
12/14/2018

ESIR: End-to-end Scene Text Recognition via Iterative Image Rectification

Automated recognition of texts in scenes has been a research challenge f...
04/22/2019

TextCohesion: Detecting Text for Arbitrary Shapes

In this paper, we propose a pixel-wise detector named TextCohesion for s...
09/16/2020

Exploring Font-independent Features for Scene Text Recognition

Scene text recognition (STR) has been extensively studied in last few ye...