Diversity Promoting Online Sampling for Streaming Video Summarization

10/29/2016
by   Rushil Anirudh, et al.
0

Many applications benefit from sampling algorithms where a small number of well chosen samples are used to generalize different properties of a large dataset. In this paper, we use diverse sampling for streaming video summarization. Several emerging applications support streaming video, but existing summarization algorithms need access to the entire video which requires a lot of memory and computational power. We propose a memory efficient and computationally fast, online algorithm that uses competitive learning for diverse sampling. Our algorithm is a generalization of online K-means such that the cost function reduces clustering error, while also ensuring a diverse set of samples. The diversity is measured as the volume of a convex hull around the samples. Finally, the performance of the proposed algorithm is measured against human users for 50 videos in the VSUMM dataset. The algorithm performs better than batch mode summarization, while requiring significantly lower memory and computational requirements.

READ FULL TEXT
research
05/12/2021

kMatrix: A Space Efficient Streaming Graph Summarization Technique

The amount of collected information on data repositories has vastly incr...
research
04/10/2020

Online Bitrate Selection for Viewport Adaptive 360-Degree Video Streaming

360-degree video streaming provides users with immersive experience by l...
research
02/08/2018

Learning to score and summarize figure skating sport videos

This paper focuses on fully understanding the figure skating sport video...
research
07/28/2018

Improving Sequential Determinantal Point Processes for Supervised Video Summarization

It is now much easier than ever before to produce videos. While the ubiq...
research
01/12/2023

Learning to Summarize Videos by Contrasting Clips

Video summarization aims at choosing parts of a video that narrate a sto...
research
08/23/2021

StreaMRAK a Streaming Multi-Resolution Adaptive Kernel Algorithm

Kernel ridge regression (KRR) is a popular scheme for non-linear non-par...

Please sign up or login with your details

Forgot password? Click here to reset