DeepAI
Log In Sign Up

Style transfer based data augmentation in material microscopic image processing

05/12/2019
by   Boyuan Ma, et al.
0

Recently progress in material microscopic image semantic segmentation has been driven by high-capacity models trained on large datasets. However, collecting microscopic images with pixel-level labels has been extremely costly due to the amount of human effort required. In this paper, we present an approach to rapidly creating microscopic images with pixel-level labels from material 3d simulated models. Usually images extracted directly from those 3d simulated models are not realistic enough. It is easy to get semantic labels, though. We introduce style transfer technique to make simulated image data more similar to real microscopic data. We validate the presented approach by using real image data from experiment and simulated image data from Monte Carlo Potts Models, which simulate the growth of polycrystal. Experiments show that using the acquired simulated image data and style transfer technique to supplement real images of polycrystalline iron significantly improves the mean precision of image processing. Besides, models trained with simulated image data and just 1/3 of the real data outperform models trained on the complete real image data. In the study of such polycrystalline materials, this approach can reduce pressure of getting and labeling images from microscopes. Also, it can be applied to numbers of other material images.

READ FULL TEXT
08/07/2016

Playing for Data: Ground Truth from Computer Games

Recent progress in computer vision has been driven by high-capacity mode...
11/09/2021

Data privacy protection in microscopic image analysis for material data mining

Recent progress in material data mining has been driven by high-capacity...
03/18/2022

Deepfake Style Transfer Mixture: a First Forensic Ballistics Study on Synthetic Images

Most recent style-transfer techniques based on generative architectures ...
01/07/2023

Mimicking non-ideal instrument behavior for hologram processing using neural style translation

Holographic cloud probes provide unprecedented information on cloud part...
06/11/2020

Transferring and Regularizing Prediction for Semantic Segmentation

Semantic segmentation often requires a large set of images with pixel-le...
11/16/2018

Generative Model for Material Experiments Based on Prior Knowledge and Attention Mechanism

Material irradiation experiment is dangerous and complex, thus it requir...