A Question-Answering framework for plots using Deep learning

06/12/2018
by   Revanth Reddy, et al.
0

Deep Learning has managed to push boundaries in a wide variety of tasks. One area of interest is to tackle problems in reasoning and understanding, in an aim to emulate human intelligence. In this work, we describe a deep learning model that addresses the reasoning task of question-answering on bar graphs and pie charts. We introduce a novel architecture that learns to identify various plot elements, quantify the represented values and determine a relative ordering of these statistical values. We test our model on the recently released FigureQA dataset, which provides images and accompanying questions, for bar graphs and pie charts, augmented with rich annotations. Our approach outperforms the state-of-the-art Relation Networks baseline and traditional CNN-LSTM models when evaluated on this dataset. Our model also has a considerably faster training time of approximately 2 days on 1 GPU compared to the Relation Networks baseline

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/05/2017

A simple neural network module for relational reasoning

Relational reasoning is a central component of generally intelligent beh...
research
03/14/2023

Evaluation of ChatGPT as a Question Answering System for Answering Complex Questions

ChatGPT is a powerful large language model (LLM) that has made remarkabl...
research
04/10/2019

Advances in Natural Language Question Answering: A Review

Question Answering has recently received high attention from artificial ...
research
07/07/2018

Robust and Scalable Differentiable Neural Computer for Question Answering

Deep learning models are often not easily adaptable to new tasks and req...
research
12/05/2017

Strong Baselines for Simple Question Answering over Knowledge Graphs with and without Neural Networks

We examine the problem of question answering over knowledge graphs, focu...
research
10/19/2017

FigureQA: An Annotated Figure Dataset for Visual Reasoning

We introduce FigureQA, a visual reasoning corpus of over one million que...

Please sign up or login with your details

Forgot password? Click here to reset