Point-wise mutual information-based video segmentation with high temporal consistency

06/08/2016
by   Margret Keuper, et al.
0

In this paper, we tackle the problem of temporally consistent boundary detection and hierarchical segmentation in videos. While finding the best high-level reasoning of region assignments in videos is the focus of much recent research, temporal consistency in boundary detection has so far only rarely been tackled. We argue that temporally consistent boundaries are a key component to temporally consistent region assignment. The proposed method is based on the point-wise mutual information (PMI) of spatio-temporal voxels. Temporal consistency is established by an evaluation of PMI-based point affinities in the spectral domain over space and time. Thus, the proposed method is independent of any optical flow computation or previously learned motion models. The proposed low-level video segmentation method outperforms the learning-based state of the art in terms of standard region metrics.

READ FULL TEXT

page 2

page 5

page 7

page 8

research
05/30/2023

Video ControlNet: Towards Temporally Consistent Synthetic-to-Real Video Translation Using Conditional Image Diffusion Models

In this study, we present an efficient and effective approach for achiev...
research
12/30/2015

LIBSVX: A Supervoxel Library and Benchmark for Early Video Processing

Supervoxel segmentation has strong potential to be incorporated into ear...
research
10/24/2021

AuxAdapt: Stable and Efficient Test-Time Adaptation for Temporally Consistent Video Semantic Segmentation

In video segmentation, generating temporally consistent results across f...
research
01/15/2022

Learning Temporally and Semantically Consistent Unpaired Video-to-video Translation Through Pseudo-Supervision From Synthetic Optical Flow

Unpaired video-to-video translation aims to translate videos between a s...
research
06/19/2023

A spatio-temporal network for video semantic segmentation in surgical videos

Semantic segmentation in surgical videos has applications in intra-opera...
research
10/17/2021

Temporally stable video segmentation without video annotations

Temporally consistent dense video annotations are scarce and hard to col...
research
06/08/2022

Learning Task Agnostic Temporal Consistency Correction

Due to the scarcity of video processing methodologies, image processing ...

Please sign up or login with your details

Forgot password? Click here to reset