Log In Sign Up

TeLCoS: OnDevice Text Localization with Clustering of Script

by   Rachit S Munjal, et al.

Recent research in the field of text localization in a resource constrained environment has made extensive use of deep neural networks. Scene text localization and recognition on low-memory mobile devices have a wide range of applications including content extraction, image categorization and keyword based image search. For text recognition of multi-lingual localized text, the OCR systems require prior knowledge of the script of each text instance. This leads to word script identification being an essential step for text recognition. Most existing methods treat text localization, script identification and text recognition as three separate tasks. This makes script identification an overhead in the recognition pipeline. To reduce this overhead, we propose TeLCoS: OnDevice Text Localization with Clustering of Script, a multi-task dual branch lightweight CNN network that performs real-time on device Text Localization and High-level Script Clustering simultaneously. The network drastically reduces the number of calls to a separate script identification module, by grouping and identifying some majorly used scripts through a single feed-forward pass over the localization network. We also introduce a novel structural similarity based channel pruning mechanism to build an efficient network with only 1.15M parameters. Experiments on benchmark datasets suggest that our method achieves state-of-the-art performance, with execution latency of 60 ms for the entire pipeline on the Exynos 990 chipset device.


page 1

page 2

page 3

page 4

page 6

page 8


A Multitask Network for Localization and Recognition of Text in Images

We present an end-to-end trainable multi-task network that addresses the...

E2E-MLT - an Unconstrained End-to-End Method for Multi-Language Scene Text

An end-to-end method for multi-language scene text localization, recogni...

STRIDE : Scene Text Recognition In-Device

Optical Character Recognition (OCR) systems have been widely used in var...

On-Device Spatial Attention based Sequence Learning Approach for Scene Text Script Identification

Automatic identification of script is an essential component of a multil...

TLGAN: document Text Localization using Generative Adversarial Nets

Text localization from the digital image is the first step for the optic...

A Multiplexed Network for End-to-End, Multilingual OCR

Recent advances in OCR have shown that an end-to-end (E2E) training pipe...

On-device Scalable Image-based Localization

We present the scalable design of an entire on-device system for large-s...