Sentence Guided Temporal Modulation for Dynamic Video Thumbnail Generation

08/31/2020
by   Mrigank Rochan, et al.
1

We consider the problem of sentence specified dynamic video thumbnail generation. Given an input video and a user query sentence, the goal is to generate a video thumbnail that not only provides the preview of the video content, but also semantically corresponds to the sentence. In this paper, we propose a sentence guided temporal modulation (SGTM) mechanism that utilizes the sentence embedding to modulate the normalized temporal activations of the video thumbnail generation network. Unlike the existing state-of-the-art method that uses recurrent architectures, we propose a non-recurrent framework that is simple and allows much more parallelization. Extensive experiments and analysis on a large-scale dataset demonstrate the effectiveness of our framework.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 9

10/31/2019

Semantic Conditioned Dynamic Modulation for Temporal Sentence Grounding in Videos

Temporal sentence grounding in videos aims to detect and localize one ta...
08/12/2019

Sentence Specified Dynamic Video Thumbnail Generation

With the tremendous growth of videos over the Internet, video thumbnails...
04/19/2018

To Find Where You Talk: Temporal Sentence Localization in Video with Attention Based Location Regression

Given an untrimmed video and a sentence description, temporal sentence l...
08/25/2016

Title Generation for User Generated Videos

A great video title describes the most salient event compactly and captu...
09/03/2021

Contrastive Representation Learning for Exemplar-Guided Paraphrase Generation

Exemplar-Guided Paraphrase Generation (EGPG) aims to generate a target s...
04/23/2016

Word2VisualVec: Image and Video to Sentence Matching by Visual Feature Prediction

This paper strives to find the sentence best describing the content of a...
10/21/2021

Video and Text Matching with Conditioned Embeddings

We present a method for matching a text sentence from a given corpus to ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.