Big Machinery Data Preprocessing Methodology for Data-Driven Models in Prognostics and Health Management

by   Sergio Cofre-Martel, et al.

Sensor monitoring networks and advances in big data analytics have guided the reliability engineering landscape to a new era of big machinery data. Low-cost sensors, along with the evolution of the internet of things and industry 4.0, have resulted in rich databases that can be analyzed through prognostics and health management (PHM) frameworks. Several da-ta-driven models (DDMs) have been proposed and applied for diagnostics and prognostics purposes in complex systems. However, many of these models are developed using simulated or experimental data sets, and there is still a knowledge gap for applications in real operating systems. Furthermore, little attention has been given to the required data preprocessing steps compared to the training processes of these DDMs. Up to date, research works do not follow a formal and consistent data preprocessing guideline for PHM applications. This paper presents a comprehensive, step-by-step pipeline for the preprocessing of monitoring data from complex systems aimed for DDMs. The importance of expert knowledge is discussed in the context of data selection and label generation. Two case studies are presented for validation, with the end goal of creating clean data sets with healthy and unhealthy labels that are then used to train machinery health state classifiers.



There are no comments yet.


page 17


A Spark ML driven preprocessing approach for deep learning based scholarly data applications

Big data has found applications in multiple domains. One of the largest ...

Preprocessing and Modeling of Radial Fan Data for Health State Prediction

Monitoring critical components of systems is a crucial step towards fail...

Smart Asset Management for Electric Utilities: Big Data and Future

This paper discusses about needs and ways to improve predictive maintena...

Trends of digitalization and adoption of big data analytics among UK SMEs: Analysis and lessons drawn from a case study of 53 SMEs

Small and Medium Enterprises (SMEs) now generate digital data at an unpr...

A Fast, Scalable, Universal Approach For Distributed Data Aggregations

In the current era of Big Data, data engineering has transformed into an...

Develop Health Monitoring and Management System to Track Health Condition and Nutrient Balance for School Students

Health Monitoring and Management System (HMMS) is an emerging technology...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.