DeepAI AI Chat
Log In Sign Up

Portmanteauing Features for Scene Text Recognition

by   Yew Lee Tan, et al.

Scene text images have different shapes and are subjected to various distortions, e.g. perspective distortions. To handle these challenges, the state-of-the-art methods rely on a rectification network, which is connected to the text recognition network. They form a linear pipeline which uses text rectification on all input images, even for images that can be recognized without it. Undoubtedly, the rectification network improves the overall text recognition performance. However, in some cases, the rectification network generates unnecessary distortions on images, resulting in incorrect predictions in images that would have otherwise been correct without it. In order to alleviate the unnecessary distortions, the portmanteauing of features is proposed. The portmanteau feature, inspired by the portmanteau word, is a feature containing information from both the original text image and the rectified image. To generate the portmanteau feature, a non-linear input pipeline with a block matrix initialization is presented. In this work, the transformer is chosen as the recognition network due to its utilization of attention and inherent parallelism, which can effectively handle the portmanteau feature. The proposed method is examined on 6 benchmarks and compared with 13 state-of-the-art methods. The experimental results show that the proposed method outperforms the state-of-the-art methods on various of the benchmarks.


page 6

page 10

page 11

page 12

page 13


Scene Text Recognition via Transformer

Scene text recognition with arbitrary shape is very challenging due to l...

Pure Transformer with Integrated Experts for Scene Text Recognition

Scene text recognition (STR) involves the task of reading text in croppe...

IFR: Iterative Fusion Based Recognizer For Low Quality Scene Text Recognition

Although recent works based on deep learning have made progress in impro...

EAST: An Efficient and Accurate Scene Text Detector

Previous approaches for scene text detection have already achieved promi...

Natural Scene Recognition Based on Superpixels and Deep Boltzmann Machines

The Deep Boltzmann Machines (DBM) is a state-of-the-art unsupervised lea...

2D-CTC for Scene Text Recognition

Scene text recognition has been an important, active research topic in c...