Marior: Margin Removal and Iterative Content Rectification for Document Dewarping in the Wild

07/23/2022
by   Jiaxin Zhang, et al.
0

Camera-captured document images usually suffer from perspective and geometric deformations. It is of great value to rectify them when considering poor visual aesthetics and the deteriorated performance of OCR systems. Recent learning-based methods intensively focus on the accurately cropped document image. However, this might not be sufficient for overcoming practical challenges, including document images either with large marginal regions or without margins. Due to this impracticality, users struggle to crop documents precisely when they encounter large marginal regions. Simultaneously, dewarping images without margins is still an insurmountable problem. To the best of our knowledge, there is still no complete and effective pipeline for rectifying document images in the wild. To address this issue, we propose a novel approach called Marior (Margin Removal and Content Rectification). Marior follows a progressive strategy to iteratively improve the dewarping quality and readability in a coarse-to-fine manner. Specifically, we divide the pipeline into two modules: margin removal module (MRM) and iterative content rectification module (ICRM). First, we predict the segmentation mask of the input image to remove the margin, thereby obtaining a preliminary result. Then we refine the image further by producing dense displacement flows to achieve content-aware rectification. We determine the number of refinement iterations adaptively. Experiments demonstrate the state-of-the-art performance of our method on public benchmarks. The resources are available at https://github.com/ZZZHANG-jx/Marior for further comparison.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 8

page 10

page 11

research
07/24/2023

MataDoc: Margin and Text Aware Document Dewarping for Arbitrary Boundary

Document dewarping from a distorted camera-captured image is of great va...
research
06/13/2023

PSSTRNet: Progressive Segmentation-guided Scene Text Removal Network

Scene text removal (STR) is a challenging task due to the complex text f...
research
09/11/2017

Recovering Homography from Camera Captured Documents using Convolutional Neural Networks

Removing perspective distortion from hand held camera captured document ...
research
12/06/2021

A Survey on Deep learning based Document Image Enhancement

Digitized documents such as scientific articles, tax forms, invoices, co...
research
09/13/2023

ShaDocFormer: A Shadow-attentive Threshold Detector with Cascaded Fusion Refiner for document shadow removal

Document shadow is a common issue that arise when capturing documents us...
research
10/28/2021

DocScanner: Robust Document Image Rectification with Progressive Learning

Compared to flatbed scanners, portable smartphones are much more conveni...
research
03/22/2023

LP-IOANet: Efficient High Resolution Document Shadow Removal

Document shadow removal is an integral task in document enhancement pipe...

Please sign up or login with your details

Forgot password? Click here to reset