DEEVA: A Deep Learning and IoT Based Computer Vision System to Address Safety and Security of Production Sites in Energy Industry

by   Nimish M. Awalgaonkar, et al.

When it comes to addressing the safety/security related needs at different production/construction sites, accurate detection of the presence of workers, vehicles, equipment important and formed an integral part of computer vision-based surveillance systems (CVSS). Traditional CVSS systems focus on the use of different computer vision and pattern recognition algorithms overly reliant on manual extraction of features and small datasets, limiting their usage because of low accuracy, need for expert knowledge and high computational costs. The main objective of this paper is to provide decision makers at sites with a practical yet comprehensive deep learning and IoT based solution to tackle various computer vision related problems such as scene classification, object detection in scenes, semantic segmentation, scene captioning etc. Our overarching goal is to address the central question of What is happening at this site and where is it happening in an automated fashion minimizing the need for human resources dedicated to surveillance. We developed Deep ExxonMobil Eye for Video Analysis (DEEVA) package to handle scene classification, object detection, semantic segmentation and captioning of scenes in a hierarchical approach. The results reveal that transfer learning with the RetinaNet object detector is able to detect the presence of workers, different types of vehicles/construction equipment, safety related objects at a high level of accuracy (above 90 features and IoT technology to automatic capture, transfer and process vast amount of realtime images, this framework is an important step towards the development of intelligent surveillance systems aimed at addressing myriads of open ended problems in the realm of security/safety monitoring, productivity assessments and future decision making.



There are no comments yet.


page 2

page 5


A Framework for Fast Scalable BNN Inference using Googlenet and Transfer Learning

Efficient and accurate object detection in video and image analysis is o...

SODA: Site Object Detection dAtaset for Deep Learning in Construction

Computer vision-based deep learning object detection algorithms have bee...

A deep learning based solution for construction equipment detection: from development to deployment

This paper aims at providing researchers and engineering professionals w...

Hard hat wearing detection based on head keypoint localization

In recent years, a lot of attention is paid to deep learning methods in ...

Advances in Deep Space Exploration via Simulators Deep Learning

The StarLight program conceptualizes fast interstellar travel via small ...

Automatic Safety Helmet Wearing Detection

Surveillance is essential for the safety of power substation. The detect...

Toolbox Spotter: A Computer Vision System for Real World Situational Awareness in Heavy Industries

The majority of fatalities and traumatic injuries in heavy industries in...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.