Sentence Guided Temporal Modulation for Dynamic Video Thumbnail Generation

08/31/2020
by   Mrigank Rochan, et al.
1

We consider the problem of sentence specified dynamic video thumbnail generation. Given an input video and a user query sentence, the goal is to generate a video thumbnail that not only provides the preview of the video content, but also semantically corresponds to the sentence. In this paper, we propose a sentence guided temporal modulation (SGTM) mechanism that utilizes the sentence embedding to modulate the normalized temporal activations of the video thumbnail generation network. Unlike the existing state-of-the-art method that uses recurrent architectures, we propose a non-recurrent framework that is simple and allows much more parallelization. Extensive experiments and analysis on a large-scale dataset demonstrate the effectiveness of our framework.

READ FULL TEXT

page 1

page 2

page 9

research
10/31/2019

Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videos

Temporal sentence grounding in videos aims to detect and localize one ta...
research
08/12/2019

Sentence Specified Dynamic Video Thumbnail Generation

With the tremendous growth of videos over the Internet, video thumbnails...
research
04/19/2018

To Find Where You Talk: Temporal Sentence Localization in Video with Attention Based Location Regression

Given an untrimmed video and a sentence description, temporal sentence l...
research
08/25/2016

Title Generation for User Generated Videos

A great video title describes the most salient event compactly and captu...
research
09/03/2021

Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation

Exemplar-Guided Paraphrase Generation (EGPG) aims to generate a target s...
research
04/15/2021

Sentence-Permuted Paragraph Generation

Generating paragraphs of diverse contents is important in many applicati...
research
04/23/2016

Word2VisualVec: Image and Video to Sentence Matching by Visual Feature Prediction

This paper strives to find the sentence best describing the content of a...

Please sign up or login with your details

Forgot password? Click here to reset