Text-Aware Single Image Specular Highlight Removal

08/16/2021
by   Shiyu Hou, et al.
0

Removing undesirable specular highlight from a single input image is of crucial importance to many computer vision and graphics tasks. Existing methods typically remove specular highlight for medical images and specific-object images, however, they cannot handle the images with text. In addition, the impact of specular highlight on text recognition is rarely studied by text detection and recognition community. Therefore, in this paper, we first raise and study the text-aware single image specular highlight removal problem. The core goal is to improve the accuracy of text detection and recognition by removing the highlight from text images. To tackle this challenging problem, we first collect three high-quality datasets with fine-grained annotations, which will be appropriately released to facilitate the relevant research. Then, we design a novel two-stage network, which contains a highlight detection network and a highlight removal network. The output of highlight detection network provides additional information about highlight regions to guide the subsequent highlight removal network. Moreover, we suggest a measurement set including the end-to-end text detection and recognition evaluation and auxiliary visual quality evaluation. Extensive experiments on our collected datasets demonstrate the superior performance of the proposed method.

READ FULL TEXT

page 2

page 5

page 9

research
07/20/2022

M2-Net: Multi-stages Specular Highlight Detection and Removal in Multi-scenes

In this paper, we propose a novel uniformity framework for highlight det...
research
12/01/2015

Fast and High Quality Highlight Removal from A Single Image

Specular reflection exists widely in photography and causes the recorded...
research
09/12/2023

Towards High-Quality Specular Highlight Removal by Leveraging Large-Scale Synthetic Data

This paper aims to remove specular highlights from a single object-level...
research
06/07/2021

Unsupervised Representation Disentanglement of Text: An Evaluation on Synthetic Datasets

To highlight the challenges of achieving representation disentanglement ...
research
04/04/2019

Blind Visual Motif Removal from a Single Image

Many images shared over the web include overlaid objects, or visual moti...
research
03/21/2020

Multi-Task Learning Enhanced Single Image De-Raining

Rain removal in images is an important task in computer vision filed and...
research
09/20/2019

Gradual Network for Single Image De-raining

Most advances in single image de-raining meet a key challenge, which is ...

Please sign up or login with your details

Forgot password? Click here to reset