Superframes, A Temporal Video Segmentation

04/18/2018
by   Hajar Sadeghi Sokeh, et al.
0

The goal of video segmentation is to turn video data into a set of concrete motion clusters that can be easily interpreted as building blocks of the video. There are some works on similar topics like detecting scene cuts in a video, but there is few specific research on clustering video data into the desired number of compact segments. It would be more intuitive, and more efficient, to work with perceptually meaningful entity obtained from a low-level grouping process which we call it superframe. This paper presents a new simple and efficient technique to detect superframes of similar content patterns in videos. We calculate the similarity of content-motion to obtain the strength of change between consecutive frames. With the help of existing optical flow technique using deep models, the proposed method is able to perform more accurate motion estimation efficiently. We also propose two criteria for measuring and comparing the performance of different algorithms on various databases. Experimental results on the videos from benchmark databases have demonstrated the effectiveness of the proposed method.

READ FULL TEXT

page 2

page 4

research
07/17/2017

MoCoGAN: Decomposing Motion and Content for Video Generation

Visual signals in a video can be divided into content and motion. While ...
research
04/13/2018

MSnet: Mutual Suppression Network for Disentangled Video Representations

The extraction of meaningful features from videos is important as they c...
research
10/14/2018

Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understanding

Learning to estimate 3D geometry in a single frame and optical flow from...
research
08/11/2020

DTVNet: Dynamic Time-lapse Video Generation via Single Still Image

This paper presents a novel end-to-end dynamic time-lapse video generati...
research
12/29/2021

Spatial Distribution Patterns of Clownfish in Recirculating Aquaculture Systems

Monitoring and detecting fish behaviors provide essential information on...
research
04/18/2018

Temporal Unknown Incremental Clustering (TUIC) Model for Analysis of Traffic Surveillance Videos

Optimized scene representation is an important characteristic of a frame...
research
05/04/2021

Viewport-Aware Dynamic 360° Video Segment Categorization

Unlike conventional videos, 360 videos give freedom to users to turn the...

Please sign up or login with your details

Forgot password? Click here to reset