Automatic Generation of Grounded Visual Questions

by   Shijie Zhang, et al.
Nankai University
Tianjin University
Australian National University

In this paper, we propose the first model to be able to generate visually grounded questions with diverse types for a single image. Visual question generation is an emerging topic which aims to ask questions in natural language based on visual input. To the best of our knowledge, it lacks automatic methods to generate meaningful questions with various types for the same visual input. To circumvent the problem, we propose a model that automatically generates visually grounded questions with varying types. Our model takes as input both images and the captions generated by a dense caption model, samples the most probable question types, and generates the questions in sequel. The experimental results on two real world datasets show that our model outperforms the strongest baseline in terms of both correctness and diversity with a wide margin.


page 1

page 3

page 6


Look, Read and Ask: Learning to Ask Questions by Reading Text in Images

We present a novel problem of text-based visual question generation or T...

AI-lead Court Debate Case Investigation

The multi-role judicial debate composed of the plaintiff, defendant, and...

Creativity: Generating Diverse Questions using Variational Autoencoders

Generating diverse questions for given images is an important task for c...

Enhancing Visual Dialog Questioner with Entity-based Strategy Learning and Augmented Guesser

Considering the importance of building a good Visual Dialog (VD) Questio...

A Pig, an Angel and a Cactus Walk Into a Blender: A Descriptive Approach to Visual Blending

A descriptive approach for automatic generation of visual blends is pres...

Learning to Generate Questions with Adaptive Copying Neural Networks

Automatic question generation is an important problem in natural languag...

Improving Neural Question Generation using World Knowledge

In this paper, we propose a method for incorporating world knowledge (li...

Please sign up or login with your details

Forgot password? Click here to reset