Understanding and Preparing Data of Industrial Processes for Machine Learning Applications

09/08/2021
by   Philipp Fleck, et al.
0

Industrial applications of machine learning face unique challenges due to the nature of raw industry data. Preprocessing and preparing raw industrial data for machine learning applications is a demanding task that often takes more time and work than the actual modeling process itself and poses additional challenges. This paper addresses one of those challenges, specifically, the challenge of missing values due to sensor unavailability at different production units of nonlinear production lines. In cases where only a small proportion of the data is missing, those missing values can often be imputed. In cases of large proportions of missing data, imputing is often not feasible, and removing observations containing missing values is often the only option. This paper presents a technique, that allows to utilize all of the available data without the need of removing large amounts of observations where data is only partially available. We do not only discuss the principal idea of the presented method, but also show different possible implementations that can be applied depending on the data at hand. Finally, we demonstrate the application of the presented method with data from a steel production plant.

READ FULL TEXT

page 3

page 4

research
06/10/2020

Data science on industrial data – Today's challenges in brown field applications

Much research is done on data analytics and machine learning. In industr...
research
04/04/2023

Learning from data with structured missingness

Missing data are an unavoidable complication in many machine learning ta...
research
07/03/2018

Recovering gaps in the gamma-ray logging method

The gamma-ray logging method is one of the mandatory well logging method...
research
12/29/2022

Condensed Representation of Machine Learning Data

Training of a Machine Learning model requires sufficient data. The suffi...
research
03/16/2022

Resilient Neural Forecasting Systems

Industrial machine learning systems face data challenges that are often ...
research
04/26/2022

From Limited Annotated Raw Material Data to Quality Production Data: A Case Study in the Milk Industry (Technical Report)

Industry 4.0 offers opportunities to combine multiple sensor data source...
research
02/28/2019

Learning partially ranked data based on graph regularization

Ranked data appear in many different applications, including voting and ...

Please sign up or login with your details

Forgot password? Click here to reset