Spatio-temporal Data Augmentation for Visual Surveillance

01/25/2021
by   Jae-Yeul Kim, et al.
18

Visual surveillance aims to stably detect a foreground object using a continuous image acquired from a fixed camera. Recent deep learning methods based on supervised learning show superior performance compared to classical background subtraction algorithms. However, there is still a room for improvement in static foreground, dynamic background, hard shadow, illumination changes, camouflage, etc. In addition, most of the deep learning-based methods operates well on environments similar to training. If the testing environments are different from training ones, their performance degrades. As a result, additional training on those operating environments is required to ensure a good performance. Our previous work which uses spatio-temporal input data consisted of a number of past images, background images and current image showed promising results in different environments from training, although it uses a simple U-NET structure. In this paper, we propose a data augmentation technique suitable for visual surveillance for additional performance improvement using the same network used in our previous work. In deep learning, most data augmentation techniques deal with spatial-level data augmentation techniques for use in image classification and object detection. In this paper, we propose a new method of data augmentation in the spatio-temporal dimension suitable for our previous work. Two data augmentation methods of adjusting background model images and past images are proposed. Through this, it is shown that performance can be improved in difficult areas such as static foreground and ghost objects, compared to previous studies. Through quantitative and qualitative evaluation using SBI, LASIESTA, and our own dataset, we show that it gives superior performance compared to deep learning-based algorithms and background subtraction algorithms.

READ FULL TEXT

page 2

page 4

page 8

page 9

page 13

page 15

page 16

page 19

research
09/19/2022

An Adaptive Threshold for the Canny Edge Detection with Actor-Critic Algorithm

Visual surveillance aims to perform robust foreground object detection r...
research
11/20/2018

Learning to Detect Instantaneous Changes with Retrospective Convolution and Static Sample Synthesis

Change detection has been a challenging visual task due to the dynamic n...
research
04/01/2019

Spatio-Temporal Deep Learning-Based Undersampling Artefact Reduction for 2D Radial Cine MRI with Limited Data

In this work we reduce undersampling artefacts in two-dimensional (2D) g...
research
12/13/2022

Improving Depression estimation from facial videos with face alignment, training optimization and scheduling

Deep learning models have shown promising results in recognizing depress...
research
11/23/2020

KeepAugment: A Simple Information-Preserving Data Augmentation Approach

Data augmentation (DA) is an essential technique for training state-of-t...
research
10/27/2021

Training Lightweight CNNs for Human-Nanodrone Proximity Interaction from Small Datasets using Background Randomization

We consider the task of visually estimating the pose of a human from ima...
research
06/30/2022

InsMix: Towards Realistic Generative Data Augmentation for Nuclei Instance Segmentation

Nuclei Segmentation from histology images is a fundamental task in digit...

Please sign up or login with your details

Forgot password? Click here to reset