Meta Learning for Task-Driven Video Summarization

07/29/2019
by   Xuelong Li, et al.
0

Existing video summarization approaches mainly concentrate on sequential or structural characteristic of video data. However, they do not pay enough attention to the video summarization task itself. In this paper, we propose a meta learning method for performing task-driven video summarization, denoted by MetaL-TDVS, to explicitly explore the video summarization mechanism among summarizing processes on different videos. Particularly, MetaL-TDVS aims to excavate the latent mechanism for summarizing video by reformulating video summarization as a meta learning problem and promote generalization ability of the trained model. MetaL-TDVS regards summarizing each video as a single task to make better use of the experience and knowledge learned from processes of summarizing other videos to summarize new ones. Furthermore, MetaL-TDVS updates models via a two-fold back propagation which forces the model optimized on one video to obtain high accuracy on another video in every training step. Extensive experiments on benchmark datasets demonstrate the superiority and better generalization ability of MetaL-TDVS against several state-of-the-art methods.

READ FULL TEXT

page 4

page 7

research
08/19/2020

Query Twice: Dual Mixture Attention Meta Learning for Video Summarization

Video summarization aims to select representative frames to retain high-...
research
05/26/2018

Video Summarization Using Fully Convolutional Sequence Networks

This paper addresses the problem of video summarization. Given an input ...
research
04/22/2019

NLP Driven Ensemble Based Automatic Subtitle Generation and Semantic Video Summarization Technique

This paper proposes an automatic subtitle generation and semantic video ...
research
11/19/2018

Representation based and Attention augmented Meta learning

Deep learning based computer vision fails to work when labeled images ar...
research
12/27/2021

Video Joint Modelling Based on Hierarchical Transformer for Co-summarization

Video summarization aims to automatically generate a summary (storyboard...
research
08/05/2021

Ada-VSR: Adaptive Video Super-Resolution with Meta-Learning

Most of the existing works in supervised spatio-temporal video super-res...
research
01/21/2021

Video Summarization: Study of various techniques

A comparative study of various techniques which can be used for summariz...

Please sign up or login with your details

Forgot password? Click here to reset