Integrating and querying similar tables from PDF documents using deep learning

01/15/2019
by   Rahul Anand, et al.
0

Large amount of public data produced by enterprises are in semi-structured PDF form. Tabular data extraction from reports and other published data in PDF format is of interest for various data consolidation purposes such as analysing and aggregating financial reports of a company. Queries into the structured tabular data in PDF format are normally processed in an unstructured manner through means like text-match. This is mainly due to that the binary format of PDF documents is optimized for layout and rendering and do not have great support for automated parsing of data. Moreover, even the same table type in PDF files varies in schema, row or column headers, which makes it difficult for a query plan to cover all relevant tables. This paper proposes a deep learning based method to enable SQL-like query and analysis of financial tables from annual reports in PDF format. This is achieved through table type classification and nearest row search. We demonstrate that using word embedding trained on Google news for header match clearly outperforms the text-match based approach in traditional database. We also introduce a practical system that uses this technology to query and analyse finance tables in PDF documents from various sources.

READ FULL TEXT

page 7

page 8

page 9

research
11/21/2019

Schemaless Queries over Document Tables with Dependencies

Unstructured enterprise data such as reports, manuals and guidelines oft...
research
03/17/2020

GFTE: Graph-based Financial Table Extraction

Tabular data is a crucial form of information expression, which can orga...
research
06/29/2015

Detecting Table Region in PDF Documents Using Distant Supervision

Superior to state-of-the-art approaches which compete in table recogniti...
research
01/13/2020

Identifying Table Structure in Documents using Conditional Generative Adversarial Networks

In many industries, as well as in academic research, information is prim...
research
03/22/2019

Line-items and table understanding in structured documents

Table detection and extraction has been studied in the context of docume...
research
12/24/2014

Locating Tables in Scanned Documents for Reconstructing and Republishing (ICIAfS14)

Pool of knowledge available to the mankind depends on the source of lear...
research
02/05/2021

Analysing the use of graphs to represent the results of Systematic Reviews in Software Engineering

The presentation of results from Systematic Literature Reviews (SLRs) is...

Please sign up or login with your details

Forgot password? Click here to reset