Efficient data-driven encoding of scene motion using Eccentricity

03/03/2021
by   Bruno Costa, et al.
0

This paper presents a novel approach of representing dynamic visual scenes with static maps generated from video/image streams. Such representation allows easy visual assessment of motion in dynamic environments. These maps are 2D matrices calculated recursively, in a pixel-wise manner, that is based on the recently introduced concept of Eccentricity data analysis. Eccentricity works as a metric of a discrepancy between a particular pixel of an image and its normality model, calculated in terms of mean and variance of past readings of the same spatial region of the image. While Eccentricity maps carry temporal information about the scene, actual images do not need to be stored nor processed in batches. Rather, all the calculations are done recursively, based on a small amount of statistical information stored in memory, thus resulting in a very computationally efficient (processor- and memory-wise) method. The list of potential applications includes video-based activity recognition, intent recognition, object tracking, video description, and so on.

READ FULL TEXT

page 1

page 5

page 6

page 9

research
11/20/2017

Pixel-wise object tracking

In this paper, we propose a novel pixel-wise visual object tracking fram...
research
07/29/2012

A Survey Of Activity Recognition And Understanding The Behavior In Video Survelliance

This paper presents a review of human activity recognition and behaviour...
research
12/13/2019

Bonn Activity Maps: Dataset Description

The key prerequisite for accessing the huge potential of current machine...
research
05/12/2019

On Flow Profile Image for Video Representation

Video representation is a key challenge in many computer vision applicat...
research
03/13/2018

Dynamic Vision Sensors for Human Activity Recognition

Unlike conventional cameras which capture video at a fixed frame rate, D...
research
05/15/2018

Automated Vision-based Bridge Component Extraction Using Multiscale Convolutional Neural Networks

Image data has a great potential of helping post-earthquake visual inspe...
research
03/31/2020

Explaining Motion Relevance for Activity Recognition in Video Deep Learning Models

A small subset of explainability techniques developed initially for imag...

Please sign up or login with your details

Forgot password? Click here to reset