Building Manufacturing Deep Learning Models with Minimal and Imbalanced Training Data Using Domain Adaptation and Data Augmentation

05/31/2023
by   Adrian Shuai Li, et al.
0

Deep learning (DL) techniques are highly effective for defect detection from images. Training DL classification models, however, requires vast amounts of labeled data which is often expensive to collect. In many cases, not only the available training data is limited but may also imbalanced. In this paper, we propose a novel domain adaptation (DA) approach to address the problem of labeled training data scarcity for a target learning task by transferring knowledge gained from an existing source dataset used for a similar learning task. Our approach works for scenarios where the source dataset and the dataset available for the target learning task have same or different feature spaces. We combine our DA approach with an autoencoder-based data augmentation approach to address the problem of imbalanced target datasets. We evaluate our combined approach using image data for wafer defect prediction. The experiments show its superior performance against other algorithms when the number of labeled samples in the target dataset is significantly small and the target dataset is imbalanced.

READ FULL TEXT
research
12/13/2021

A Survey of Unsupervised Domain Adaptation for Visual Recognition

While huge volumes of unlabeled data are generated and made available in...
research
08/04/2020

Class-Incremental Domain Adaptation

We introduce a practical Domain Adaptation (DA) paradigm called Class-In...
research
08/29/2023

From SMOTE to Mixup for Deep Imbalanced Classification

Given imbalanced data, it is hard to train a good classifier using deep ...
research
09/25/2019

Data Valuation using Reinforcement Learning

Quantifying the value of data is a fundamental problem in machine learni...
research
02/18/2023

Data Augmentation for Imbalanced Regression

In this work, we consider the problem of imbalanced data in a regression...
research
08/15/2023

Domain Adaptation via Minimax Entropy for Real/Bogus Classification of Astronomical Alerts

Time domain astronomy is advancing towards the analysis of multiple mass...
research
07/13/2022

Efficient Augmentation for Imbalanced Deep Learning

Deep learning models memorize training data, which hurts their ability t...

Please sign up or login with your details

Forgot password? Click here to reset