Visual Question Answering with Memory-Augmented Networks

07/17/2017
by   Chao Ma, et al.
0

This paper exploits a memory-augmented neural network to predict accurate answers to visual questions, even when those answers occur rarely in the training set. The memory network incorporates both internal and external memory blocks and selectively pays attention to each training exemplar. We show that memory-augmented neural networks are able to maintain a relatively long-term memory of scarce training exemplars, which is important for visual question answering due to the heavy-tailed distribution of answers in a general VQA setting. Experimental results on two large scale benchmark datasets show the favorable performance of the proposed algorithm with a comparison to state of the art.

READ FULL TEXT

page 1

page 3

page 8

research
07/06/2017

Long-Term Memory Networks for Question Answering

Question answering is an important and difficult task in the natural lan...
research
12/12/2016

VIBIKNet: Visual Bidirectional Kernelized Network for Visual Question Answering

In this paper, we address the problem of visual question answering by pr...
research
07/23/2018

Question Relevance in Visual Question Answering

Free-form and open-ended Visual Question Answering systems solve the pro...
research
11/22/2017

Visual Question Answering as a Meta Learning Task

The predominant approach to Visual Question Answering (VQA) demands that...
research
12/11/2018

Learning What to Remember: Long-term Episodic Memory Networks for Learning from Streaming Data

Current generation of memory-augmented neural networks has limited scala...
research
05/16/2022

A Neuro-Symbolic ASP Pipeline for Visual Question Answering

We present a neuro-symbolic visual question answering (VQA) pipeline for...
research
07/07/2018

Robust and Scalable Differentiable Neural Computer for Question Answering

Deep learning models are often not easily adaptable to new tasks and req...

Please sign up or login with your details

Forgot password? Click here to reset