Anomaly Detection for Industrial Big Data

04/09/2018
by   Neil Caithness, et al.
0

As the Industrial Internet of Things (IIoT) grows, systems are increasingly being monitored by arrays of sensors returning time-series data at ever-increasing 'volume, velocity and variety' (i.e. Industrial Big Data). An obvious use for these data is real-time systems condition monitoring and prognostic time to failure analysis (remaining useful life, RUL). (e.g. See white papers by Senseye.io, and output of the NASA Prognostics Center of Excellence (PCoE).) However, as noted by Agrawal and Choudhary 'Our ability to collect "big data" has greatly surpassed our capability to analyze it, underscoring the emergence of the fourth paradigm of science, which is data-driven discovery.' In order to fully utilize the potential of Industrial Big Data we need data-driven techniques that operate at scales that process models cannot. Here we present a prototype technique for data-driven anomaly detection to operate at industrial scale. The method generalizes to application with almost any multivariate dataset based on independent ordinations of repeated (bootstrapped) partitions of the dataset and inspection of the joint distribution of ordinal distances.

READ FULL TEXT

page 5

page 6

page 7

research
06/29/2021

Several Typical Paradigms of Industrial Big Data Application

Industrial big data is an important part of big data family, which has i...
research
04/18/2017

Anomaly detection and motif discovery in symbolic representations of time series

The advent of the Big Data hype and the consistent recollection of event...
research
12/18/2017

Squeezed Convolutional Variational AutoEncoder for Unsupervised Anomaly Detection in Edge Device Industrial Internet of Things

In this paper, we propose Squeezed Convolutional Variational AutoEncoder...
research
06/02/2023

An OPC UA-based industrial Big Data architecture

Industry 4.0 factories are complex and data-driven. Data is yielded from...
research
03/03/2022

Anomaly Detection in Big Data

Anomaly is defined as a state of the system that do not conform to the n...
research
12/26/2020

Toward Compact Data from Big Data

Bigdata is a dataset of which size is beyond the ability of handling a v...
research
06/27/2019

Multivariate Big Data Analysis for Intrusion Detection: 5 steps from the haystack to the needle

The research literature on cybersecurity incident detection & response i...

Please sign up or login with your details

Forgot password? Click here to reset