Finding simplicity: unsupervised discovery of features, patterns, and order parameters via shift-invariant variational autoencoders

06/23/2021
by   Maxim Ziatdinov, et al.
0

Recent advances in scanning tunneling and transmission electron microscopies (STM and STEM) have allowed routine generation of large volumes of imaging data containing information on the structure and functionality of materials. The experimental data sets contain signatures of long-range phenomena such as physical order parameter fields, polarization and strain gradients in STEM, or standing electronic waves and carrier-mediated exchange interactions in STM, all superimposed onto scanning system distortions and gradual changes of contrast due to drift and/or mis-tilt effects. Correspondingly, while the human eye can readily identify certain patterns in the images such as lattice periodicities, repeating structural elements, or microstructures, their automatic extraction and classification are highly non-trivial and universal pathways to accomplish such analyses are absent. We pose that the most distinctive elements of the patterns observed in STM and (S)TEM images are similarity and (almost-) periodicity, behaviors stemming directly from the parsimony of elementary atomic structures, superimposed on the gradual changes reflective of order parameter distributions. However, the discovery of these elements via global Fourier methods is non-trivial due to variability and lack of ideal discrete translation symmetry. To address this problem, we develop shift-invariant variational autoencoders (shift-VAE) that allow disentangling characteristic repeating features in the images, their variations, and shifts inevitable for random sampling of image space. Shift-VAEs balance the uncertainty in the position of the object of interest with the uncertainty in shape reconstruction. This approach is illustrated for model 1D data, and further extended to synthetic and experimental STM and STEM 2D data.

READ FULL TEXT

page 9

page 11

page 12

page 13

page 15

page 17

research
03/30/2023

Physics and Chemistry from Parsimonious Representations: Image Analysis via Invariant Variational Autoencoders

Electron, optical, and scanning probe microscopy methods are generating ...
research
04/20/2021

Robust Feature Disentanglement in Imaging Data via Joint Invariant Variational Autoencoders: from Cards to Atoms

Recent advances in imaging from celestial objects in astronomy visualize...
research
04/20/2021

Decoding the shift-invariant data: applications for band-excitation scanning probe microscopy

A shift-invariant variational autoencoder (shift-VAE) is developed as an...
research
02/08/2023

Combining Variational Autoencoders and Physical Bias for Improved Microscopy Data Analysis

Electron and scanning probe microscopy produce vast amounts of data in t...
research
05/24/2021

Semi-supervised learning of images with strong rotational disorder: assembling nanoparticle libraries

The proliferation of optical, electron, and scanning probe microscopies ...
research
11/04/2020

Polymers for Extreme Conditions Designed Using Syntax-Directed Variational Autoencoders

The design/discovery of new materials is highly non-trivial owing to the...
research
09/20/2023

Generalizing Across Domains in Diabetic Retinopathy via Variational Autoencoders

Domain generalization for Diabetic Retinopathy (DR) classification allow...

Please sign up or login with your details

Forgot password? Click here to reset