A General Framework for Edited Video and Raw Video Summarization

04/24/2019
by   Xuelong Li, et al.
0

In this paper, we build a general summarization framework for both of edited video and raw video summarization. Overall, our work can be divided into three folds: 1) Four models are designed to capture the properties of video summaries, i.e., containing important people and objects (importance), representative to the video content (representativeness), no similar key-shots (diversity) and smoothness of the storyline (storyness). Specifically, these models are applicable to both edited videos and raw videos. 2) A comprehensive score function is built with the weighted combination of the aforementioned four models. Note that the weights of the four models in the score function, denoted as property-weight, are learned in a supervised manner. Besides, the property-weights are learned for edited videos and raw videos, respectively. 3) The training set is constructed with both edited videos and raw videos in order to make up the lack of training data. Particularly, each training video is equipped with a pair of mixing-coefficients which can reduce the structure mess in the training set caused by the rough mixture. We test our framework on three datasets, including edited videos, short raw videos and long raw videos. Experimental results have verified the effectiveness of the proposed framework.

READ FULL TEXT

page 1

page 3

page 5

page 8

page 9

page 10

page 11

page 12

research
05/30/2018

Learning Video Summarization Using Unpaired Data

We consider the problem of video summarization. Given an input raw video...
research
01/07/2022

Video Summarization Based on Video-text Modelling

Modern video summarization methods are based on deep neural networks whi...
research
02/08/2018

Learning to score and summarize figure skating sport videos

This paper focuses on fully understanding the figure skating sport video...
research
10/28/2019

Few-shot Video-to-Video Synthesis

Video-to-video synthesis (vid2vid) aims at converting an input semantic ...
research
04/04/2017

A Unified Multi-Faceted Video Summarization System

This paper addresses automatic summarization and search in visual data c...
research
10/23/2020

Short Video-based Advertisements Evaluation System: Self-Organizing Learning Approach

With the rising of short video apps, such as TikTok, Snapchat and Kwai, ...

Please sign up or login with your details

Forgot password? Click here to reset