Journalistic Guidelines Aware News Image Captioning

09/07/2021
by   Xuewen Yang, et al.
0

The task of news article image captioning aims to generate descriptive and informative captions for news article images. Unlike conventional image captions that simply describe the content of the image in general terms, news image captions follow journalistic guidelines and rely heavily on named entities to describe the image content, often drawing context from the whole article they are associated with. In this work, we propose a new approach to this task, motivated by caption guidelines that journalists follow. Our approach, Journalistic Guidelines Aware News Image Captioning (JoGANIC), leverages the structure of captions to improve the generation quality and guide our representation design. Experimental results, including detailed ablation studies, on two large-scale publicly available datasets show that JoGANIC substantially outperforms state-of-the-art methods both on caption generation and named entity related metrics.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2020

VisualNews : Benchmark and Challenges in Entity-aware Image Captioning

In this paper we propose VisualNews-Captioner, an entity-aware model for...
research
08/16/2023

Visually-Aware Context Modeling for News Image Captioning

The goal of News Image Captioning is to generate an image caption accord...
research
06/01/2023

"Let's not Quote out of Context": Unified Vision-Language Pretraining for Context Assisted Image Captioning

Well-formed context aware image captions and tags in enterprise content ...
research
04/21/2018

Entity-aware Image Caption Generation

Image captioning approaches currently generate descriptions which lack s...
research
12/01/2022

Focus! Relevant and Sufficient Context Selection for News Image Captioning

News Image Captioning requires describing an image by leveraging additio...
research
04/17/2020

Transform and Tell: Entity-Aware News Image Captioning

We propose an end-to-end model which generates captions for images embed...
research
09/21/2022

Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia

Humans exploit prior knowledge to describe images, and are able to adapt...

Please sign up or login with your details

Forgot password? Click here to reset