Activitynet 2019 Task 3: Exploring Contexts for Dense Captioning Events in Videos

07/11/2019

∙

by   Shizhe Chen, et al.

∙

Renmin University of China

∙

Microsoft

∙

Carnegie Mellon University

∙

0

∙

share

Contextual reasoning is essential to understand events in long untrimmed videos. In this work, we systematically explore different captioning models with various contexts for the dense-captioning events in video task, which aims to generate captions for different events in the untrimmed video. We propose five types of contexts as well as two categories of event captioning models, and evaluate their contributions for event captioning from both accuracy and diversity aspects. The proposed captioning models are plugged into our pipeline system for the dense video captioning challenge. The overall system achieves the state-of-the-art performance on the dense-captioning events in video task with 9.91 METEOR score on the challenge testing set.