High-dimensional Nonlinear Profile Monitoring based on Deep Probabilistic Autoencoders

11/01/2019
by   Nurettin Sergin, et al.
11

Wide accessibility of imaging and profile sensors in modern industrial systems created an abundance of high-dimensional sensing variables. This led to a a growing interest in the research of high-dimensional process monitoring. However, most of the approaches in the literature assume the in-control population to lie on a linear manifold with a given basis (i.e., spline, wavelet, kernel, etc) or an unknown basis (i.e., principal component analysis and its variants), which cannot be used to efficiently model profiles with a nonlinear manifold which is common in many real-life cases. We propose deep probabilistic autoencoders as a viable unsupervised learning approach to model such manifolds. To do so, we formulate nonlinear and probabilistic extensions of the monitoring statistics from classical approaches as the expected reconstruction error (ERE) and the KL-divergence (KLD) based monitoring statistics. Through extensive simulation study, we provide insights on why latent-space based statistics are unreliable and why residual-space based ones typically perform much better for deep learning based approaches. Finally, we demonstrate the superiority of deep probabilistic models via both simulation study and a real-life case study involving images of defects from a hot steel rolling process.

READ FULL TEXT

page 2

page 4

page 9

page 19

page 20

research
12/12/2020

An improved mixture of probabilistic PCA for nonlinear data-driven process monitoring

An improved mixture of probabilistic principal component analysis (PPCA)...
research
04/20/2019

High Dimensional Process Monitoring Using Robust Sparse Probabilistic Principal Component Analysis

High dimensional data has introduced challenges that are difficult to ad...
research
05/10/2023

A distribution-free change-point monitoring scheme in high-dimensional settings with application to industrial image surveillance

Existing monitoring tools for multivariate data are often asymptotically...
research
05/31/2022

SOM-CPC: Unsupervised Contrastive Learning with Self-Organizing Maps for Structured Representations of High-Rate Time Series

Continuous monitoring with an ever-increasing number of sensors has beco...
research
03/29/2023

Nonlinear Independent Component Analysis for Principled Disentanglement in Unsupervised Deep Learning

A central problem in unsupervised deep learning is how to find useful re...
research
05/19/2012

Efficient Methods for Unsupervised Learning of Probabilistic Models

In this thesis I develop a variety of techniques to train, evaluate, and...
research
01/04/2018

A practical tutorial on autoencoders for nonlinear feature fusion: Taxonomy, models, software and guidelines

Many of the existing machine learning algorithms, both supervised and un...

Please sign up or login with your details

Forgot password? Click here to reset