DeepAI AI Chat
Log In Sign Up

Video Summarization using Deep Semantic Features

by   Mayu Otani, et al.
University of Oulu
Nara Institute of Science and Technology

This paper presents a video summarization technique for an Internet video to provide a quick way to overview its content. This is a challenging problem because finding important or informative parts of the original video requires to understand its content. Furthermore the content of Internet videos is very diverse, ranging from home videos to documentaries, which makes video summarization much more tough as prior knowledge is almost not available. To tackle this problem, we propose to use deep video features that can encode various levels of content semantics, including objects, actions, and scenes, improving the efficiency of standard video summarization techniques. For this, we design a deep neural network that maps videos as well as descriptions to a common semantic space and jointly trained it with associated pairs of videos and descriptions. To generate a video summary, we extract the deep features from each segment of the original video and apply a clustering-based summarization technique to them. We evaluate our video summaries using the SumMe dataset as well as baseline approaches. The results demonstrated the advantages of incorporating our deep semantic features in a video summarization technique.


page 2

page 6

page 8

page 11

page 14


Comprehensive Video Understanding: Video summarization with content-based video recommender design

Video summarization aims to extract keyframes/shots from a long video. P...

Video Summarization Overview

With the broad growth of video capturing devices and applications on the...

NLP Driven Ensemble Based Automatic Subtitle Generation and Semantic Video Summarization Technique

This paper proposes an automatic subtitle generation and semantic video ...

Summarization of User-Generated Sports Video by Using Deep Action Recognition Features

Automatically generating a summary of sports video poses the challenge o...

Video Summarization: Study of various techniques

A comparative study of various techniques which can be used for summariz...

Video Summarization using Keyframe Extraction and Video Skimming

Video is one of the robust sources of information and the consumption of...

A Multi-stage deep architecture for summary generation of soccer videos

Video content is present in an ever-increasing number of fields, both sc...