Human Short-Long Term Cognitive Memory Mechanism for Visual Monitoring in IoT-Assisted Smart Cities

05/07/2021
by   Ali Asghar Heidari, et al.
0

In the Industry 4.0 era, the visualization and real-time automatic monitoring of smart cities supported by the Internet of Things is becoming increasingly important. The use of filtering algorithms in smart city monitoring is a feasible method for this purpose. However, maintaining fast and accurate monitoring in complex surveillance environments with restricted resources still remains a major challenge. Since the cognitive theory in visual monitoring is difficult to realize in practice, efficient monitoring of complex environments is accordingly hard to be achieved. Moreover, current monitoring methods do not consider the particularities of the human cognitive system, so the re-monitoring ability of the process/target is weak in case of monitoring failure by the monitoring system. In order to overcome these issues, this paper proposes a novel human Short-Long Cognitive Memory mechanism for video surveillance in smart cities. In this mechanism, a memory with a high reliability target is used as a “Long-Term Memory”, whereas a memory with a low reliability target is used as a “Short-Term Memory”. During the monitoring process, the “Short-Term Memory” and “Long-Term Memory” alternation strategy is combined with the stored target appearance characteristics, ensuring that the original model in the memory will not be contaminated or mislaid by changes in the external environment (occlusion, fast motion, motion blur, and background clutter). Extensive simulations showcase that the algorithm proposed in this paper not only improves the monitoring speed without hindering its real-time operation, but also monitors and traces the monitored target accurately, ultimately improving the robustness of the detection in complex scenery, and enabling its application to IoT-assisted smart cities.

READ FULL TEXT

page 1

page 3

page 6

page 9

page 11

page 12

research
08/20/2022

MemoNav: Selecting Informative Memories for Visual Navigation

Image-goal navigation is a challenging task, as it requires the agent to...
research
07/19/2018

Model-Based Monitoring for IoTs Smart Cities Applications

Smart Cities are future urban aggregations, where a multitude of heterog...
research
12/07/2020

Predicting the Transition from Short-term to Long-term Memory based on Deep Neural Network

Memory is an essential element in people's daily life based on experienc...
research
07/07/2017

Adaptive Correlation Filters with Long-Term and Short-Term Memory for Object Tracking

Object tracking is challenging as target objects often undergo drastic a...
research
12/05/2020

Bidirectional recurrent neural networks for seismic event detection

Real time, accurate passive seismic event detection is a critical safety...
research
11/26/2018

Augmenting Robot Knowledge Consultants with Distributed Short Term Memory

Human-robot communication in situated environments involves a complex in...
research
02/20/2019

Filtering Point Targets via Online Learning of Motion Models

Filtering point targets in highly cluttered and noisy data frames can be...

Please sign up or login with your details

Forgot password? Click here to reset