-
Show, Tell and Discriminate: Image Captioning by Self-retrieval with Partially Labeled Data
The aim of image captioning is to generate similar captions by machine a...
read it
-
Cooperative image captioning
When describing images with natural language, the descriptions can be ma...
read it
-
Creative Captioning: An AI Grand Challenge Based on the Dixit Board Game
We propose a new class of "grand challenge" AI problems that we call cre...
read it
-
Show, Edit and Tell: A Framework for Editing Image Captions
Most image captioning frameworks generate captions directly from images,...
read it
-
Chittron: An Automatic Bangla Image Captioning System
Automatic image caption generation aims to produce an accurate descripti...
read it
-
Lifelong Learning for Image Captioning by Asking Natural Language Questions
In order to bring artificial agents into our lives, we will need to go b...
read it
-
SPASS: Scientific Prominence Active Search System with Deep Image Captioning Network
Planetary exploration missions with Mars rovers are complicated, which g...
read it
Structural and Functional Decomposition for Personality Image Captioning in a Communication Game
Personality image captioning (PIC) aims to describe an image with a natural language caption given a personality trait. In this work, we introduce a novel formulation for PIC based on a communication game between a speaker and a listener. The speaker attempts to generate natural language captions while the listener encourages the generated captions to contain discriminative information about the input images and personality traits. In this way, we expect that the generated captions can be improved to naturally represent the images and express the traits. In addition, we propose to adapt the language model GPT2 to perform caption generation for PIC. This enables the speaker and listener to benefit from the language encoding capacity of GPT2. Our experiments show that the proposed model achieves the state-of-the-art performance for PIC.
READ FULL TEXT
Comments
There are no comments yet.