DeepAI AI Chat
Log In Sign Up

TedEval: A Fair Evaluation Metric for Scene Text Detectors

07/02/2019
by   Chae Young Lee, et al.
NAVER Corp.
1

Despite the recent success of scene text detection methods, common evaluation metrics fail to provide a fair and reliable comparison among detectors. They have obvious drawbacks in reflecting the inherent characteristic of text detection tasks, unable to address issues such as granularity, multiline, and character incompleteness. In this paper, we propose a novel evaluation protocol called TedEval (Text detector Evaluation), which evaluates text detections by an instance-level matching and a character-level scoring. Based on a firm standard rewarding behaviors that result in successful recognition, TedEval can act as a reliable standard for comparing and quantizing the detection quality throughout all difficulty levels. In this regard, we believe that TedEval can play a key role in developing state-of-the-art scene text detectors. The code is publicly available at https://github.com/clovaai/TedEval.

READ FULL TEXT

page 1

page 4

page 6

page 7

06/11/2020

CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks

Despite the recent success of text detection and recognition methods, ex...
03/27/2019

Tightness-aware Evaluation Protocol for Scene Text Detection

Evaluation protocols play key role in the developmental progress of text...
08/22/2017

WordSup: Exploiting Word Annotations for Character based Text Detection

Imagery texts are usually organized as a hierarchy of several visual ele...
09/17/2019

STELA: A Real-Time Scene Text Detector with Learned Anchor

To achieve high coverage of target boxes, a normal strategy of conventio...
12/27/2022

A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognition

This study focuses on improving the optical character recognition (OCR) ...
08/19/2022

Shift Variance in Scene Text Detection

Theory of convolutional neural networks suggests the property of shift e...
04/23/2016

Text Flow: A Unified Text Detection System in Natural Scene Images

The prevalent scene text detection approach follows four sequential step...