A Deep Learning Based Automatic Defect Analysis Framework for In-situ TEM Ion Irradiations

08/19/2021
by   Mingren Shen, et al.
0

Videos captured using Transmission Electron Microscopy (TEM) can encode details regarding the morphological and temporal evolution of a material by taking snapshots of the microstructure sequentially. However, manual analysis of such video is tedious, error-prone, unreliable, and prohibitively time-consuming if one wishes to analyze a significant fraction of frames for even videos of modest length. In this work, we developed an automated TEM video analysis system for microstructural features based on the advanced object detection model called YOLO and tested the system on an in-situ ion irradiation TEM video of dislocation loops formed in a FeCrAl alloy. The system provides analysis of features observed in TEM including both static and dynamic properties using the YOLO-based defect detection module coupled to a geometry analysis module and a dynamic tracking module. Results show that the system can achieve human comparable performance with an F1 score of 0.89 for fast, consistent, and scalable frame-level defect analysis. This result is obtained on a real but exceptionally clean and stable data set and more challenging data sets may not achieve this performance. The dynamic tracking also enabled evaluation of individual defect evolution like per defect growth rate at a fidelity never before achieved using common human analysis methods. Our work shows that automatically detecting and tracking interesting microstructures and properties contained in TEM videos is viable and opens new doors for evaluating materials dynamics.

READ FULL TEXT

page 3

page 13

page 14

page 21

page 24

page 25

page 28

research
08/19/2021

Multi defect detection and analysis of electron microscopy images with deep learning

Electron microscopy is widely used to explore defects in crystal structu...
research
02/10/2021

A Generic Object Re-identification System for Short Videos

Short video applications like TikTok and Kwai have been a great hit rece...
research
02/02/2023

Dynamic Atomic Column Detection in Transmission Electron Microscopy Videos via Ridge Estimation

Ridge detection is a classical tool to extract curvilinear features in i...
research
04/19/2023

Automatic Individual Identification of Patterned Solitary Species Based on Unlabeled Video Data

The manual processing and analysis of videos from camera traps is time-c...
research
07/29/2023

Automated Hit-frame Detection for Badminton Match Analysis

Sports professionals constantly under pressure to perform at the highest...
research
07/12/2023

Deep Learning of Crystalline Defects from TEM images: A Solution for the Problem of "Never Enough Training Data"

Crystalline defects, such as line-like dislocations, play an important r...
research
02/11/2020

Sperm detection and tracking in phase-contrast microscopy image sequences using deep learning and modified CSR-DCF

Nowadays, computer-aided sperm analysis (CASA) systems have made a big l...

Please sign up or login with your details

Forgot password? Click here to reset