End-to-End Hierarchical Relation Extraction for Generic Form Understanding

06/02/2021
by   Tuan-Anh Nguyen Dang, et al.
0

Form understanding is a challenging problem which aims to recognize semantic entities from the input document and their hierarchical relations. Previous approaches face significant difficulty dealing with the complexity of the task, thus treat these objectives separately. To this end, we present a novel deep neural network to jointly perform both entity detection and link prediction in an end-to-end fashion. Our model extends the Multi-stage Attentional U-Net architecture with the Part-Intensity Fields and Part-Association Fields for link prediction, enriching the spatial information flow with the additional supervision from entity linking. We demonstrate the effectiveness of the model on the Form Understanding in Noisy Scanned Documents (FUNSD) dataset, where our method substantially outperforms the original model and state-of-the-art baselines in both Entity Labeling and Entity Linking task.

READ FULL TEXT

page 4

page 7

research
04/27/2018

Improving Entity Linking by Modeling Latent Relations between Mentions

Entity linking involves aligning textual mentions of named entities to t...
research
06/21/2023

Bidirectional End-to-End Learning of Retriever-Reader Paradigm for Entity Linking

Entity Linking (EL) is a fundamental task for Information Extraction and...
research
08/23/2018

End-to-End Neural Entity Linking

Entity Linking (EL) is an essential task for semantic text understanding...
research
05/10/2021

GroupLink: An End-to-end Multitask Method for Word Grouping and Relation Extraction in Form Understanding

Forms are a common type of document in real life and carry rich informat...
research
05/27/2019

FUNSD: A Dataset for Form Understanding in Noisy Scanned Documents

In this paper, we present a new dataset for Form Understanding in Noisy ...
research
03/23/2023

Modeling Entities as Semantic Points for Visual Information Extraction in the Wild

Recently, Visual Information Extraction (VIE) has been becoming increasi...
research
12/14/2021

Text Classification Models for Form Entity Linking

Forms are a widespread type of template-based document used in a great v...

Please sign up or login with your details

Forgot password? Click here to reset