Picture What you Read

09/09/2019
by   Ignazio Gallo, et al.
7

Visualization refers to our ability to create an image in our head based on the text we read or the words we hear. It is one of the many skills that makes reading comprehension possible. Convolutional Neural Networks (CNN) are an excellent tool for recognizing and classifying text documents. In addition, it can generate images conditioned on natural language. In this work, we utilize CNNs capabilities to generate realistic images representative of the text illustrating the semantic concept. We conducted various experiments to highlight the capacity of the proposed model to generate representative images of the text descriptions used as input to the proposed model.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 7

research
06/10/2019

A Survey on Neural Machine Reading Comprehension

Enabling a machine to read and comprehend the natural language documents...
research
06/10/2015

Teaching Machines to Read and Comprehend

Teaching machines to read natural language documents remains an elusive ...
research
03/09/2021

Attention-driven read-aloud technology increases reading comprehension in children with reading disabilities

The paper presents the design of an assistive reading tool that integrat...
research
11/21/2018

Convolutional Spatial Attention Model for Reading Comprehension with Multiple-Choice Questions

Machine Reading Comprehension (MRC) with multiple-choice questions requi...
research
08/13/2021

Finding Representative Interpretations on Convolutional Neural Networks

Interpreting the decision logic behind effective deep convolutional neur...
research
09/08/2018

I Know What You Want: Semantic Learning for Text Comprehension

Who did what to whom is a major focus in natural language understanding,...
research
12/03/2022

Global memory transformer for processing long documents

Transformer variants dominate the state-of-the-art in different natural ...

Please sign up or login with your details

Forgot password? Click here to reset