Radically Lower Data-Labeling Costs for Visually Rich Document Extraction Models

10/28/2022
by   Yichao Zhou, et al.
0

A key bottleneck in building automatic extraction models for visually rich documents like invoices is the cost of acquiring the several thousand high-quality labeled documents that are needed to train a model with acceptable accuracy. We propose Selective Labeling to simplify the labeling task to provide "yes/no" labels for candidate extractions predicted by a model trained on partially labeled documents. We combine this with a custom active learning strategy to find the predictions that the model is most uncertain about. We show through experiments on document types drawn from 3 different domains that selective labeling can reduce the cost of acquiring labeled data by 10× with a negligible loss in accuracy.

READ FULL TEXT

page 2

page 8

research
02/05/2022

Improving Probabilistic Models in Text Classification via Active Learning

When using text data, social scientists often classify documents in orde...
research
04/15/2021

Adaptive Active Learning for Coreference Resolution

Training coreference resolution models require comprehensively labeled d...
research
03/13/2021

Lightweight Selective Disclosure for Verifiable Documents on Blockchain

To achieve lightweight selective disclosure for protecting privacy of do...
research
05/23/2022

Document Intelligence Metrics for Visually Rich Document Evaluation

The processing of Visually-Rich Documents (VRDs) is highly important in ...
research
08/04/2021

Human-In-The-Loop Document Layout Analysis

Document layout analysis (DLA) aims to divide a document image into diff...
research
09/03/2015

Incremental Active Opinion Learning Over a Stream of Opinionated Documents

Applications that learn from opinionated documents, like tweets or produ...
research
12/02/2020

Unsupervised Neural Domain Adaptation for Document Image Binarization

Binarization is a well-known image processing task, whose objective is t...

Please sign up or login with your details

Forgot password? Click here to reset