Reverse-engineering Bar Charts Using Neural Networks

09/05/2020
by   Fangfang Zhou, et al.
18

Reverse-engineering bar charts extracts textual and numeric information from the visual representations of bar charts to support application scenarios that require the underlying information. In this paper, we propose a neural network-based method for reverse-engineering bar charts. We adopt a neural network-based object detection model to simultaneously localize and classify textual information. This approach improves the efficiency of textual information extraction. We design an encoder-decoder framework that integrates convolutional and recurrent neural networks to extract numeric information. We further introduce an attention mechanism into the framework to achieve high accuracy and robustness. Synthetic and real-world datasets are used to evaluate the effectiveness of the method. To the best of our knowledge, this work takes the lead in constructing a complete neural network-based method of reverse-engineering bar charts.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 4

page 8

04/25/2020

Detective: An Attentive Recurrent Model for Sparse Object Detection

In this work, we present Detective - an attentive object detector that i...
05/03/2015

ReNet: A Recurrent Neural Network Based Alternative to Convolutional Networks

In this paper, we propose a deep neural network architecture for object ...
12/05/2015

Generating News Headlines with Recurrent Neural Networks

We describe an application of an encoder-decoder recurrent neural networ...
03/06/2020

A Neural Network Based Framework for Archetypical Sound SYnthesis

This paper describes a preliminary approach to algorithmically reproduce...
03/08/2021

Analysis of Convolutional Decoder for Image Caption Generation

Recently Convolutional Neural Networks have been proposed for Sequence M...
08/07/2020

Textual Description for Mathematical Equations

Reading of mathematical expression or equation in the document images is...
05/01/2018

Adaptive Scaling for Sparse Detection in Information Extraction

This paper focuses on detection tasks in information extraction, where p...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.