LDRNet: Enabling Real-time Document Localization on Mobile Devices

06/05/2022
by   Han Wu, et al.
0

While Identity Document Verification (IDV) technology on mobile devices becomes ubiquitous in modern business operations, the risk of identity theft and fraud is increasing. The identity document holder is normally required to participate in an online video interview to circumvent impostors. However, the current IDV process depends on an additional human workforce to support online step-by-step guidance which is inefficient and expensive. The performance of existing AI-based approaches cannot meet the real-time and lightweight demands of mobile devices. In this paper, we address those challenges by designing an edge intelligence-assisted approach for real-time IDV. Aiming at improving the responsiveness of the IDV process, we propose a new document localization model for mobile devices, LDRNet, to Localize the identity Document in Real-time. On the basis of a lightweight backbone network, we build three prediction branches for LDRNet, the corner points prediction, the line borders prediction and the document classification. We design novel supplementary targets, the equal-division points, and use a new loss function named Line Loss, to improve the speed and accuracy of our approach. In addition to the IDV process, LDRNet is an efficient and reliable document localization alternative for all kinds of mobile applications. As a matter of proof, we compare the performance of LDRNet with other popular approaches on localizing general document datasets. The experimental results show that LDRNet runs at a speed up to 790 FPS which is 47x faster, while still achieving comparable Jaccard Index(JI) in single-model and single-scale tests.

READ FULL TEXT

page 1

page 3

page 5

page 7

research
07/16/2018

A Dataset for Identity Documents Analysis and Recognition on Mobile Devices in Video Stream

A lot of research has been devoted to identity documents analysis and re...
research
07/16/2018

MIDV-500: A Dataset for Identity Documents Analysis and Recognition on Mobile Devices in Video Stream

A lot of research has been devoted to identity documents analysis and re...
research
12/28/2021

A Metamodel and Prototype for Fluid Document Formats

With the transformation of computing from personal computers to the Inte...
research
06/01/2021

Towards Real-time and Light-weight Line Segment Detection

Previous deep learning-based line segment detection (LSD) suffer from th...
research
04/20/2018

MobileFaceNets: Efficient CNNs for Accurate Real-time Face Verification on Mobile Devices

In this paper, we present a class of extremely efficient CNN models call...
research
01/11/2022

MobileFaceSwap: A Lightweight Framework for Video Face Swapping

Advanced face swapping methods have achieved appealing results. However,...
research
11/27/2019

Methods of Weighted Combination for Text Field Recognition in a Video Stream

Due to a noticeable expansion of document recognition applicability, the...

Please sign up or login with your details

Forgot password? Click here to reset