AI-assisted Automated Workflow for Real-time X-ray Ptychography Data Analysis via Federated Resources

04/09/2023
by   Anakha V Babu, et al.
0

We present an end-to-end automated workflow that uses large-scale remote compute resources and an embedded GPU platform at the edge to enable AI/ML-accelerated real-time analysis of data collected for x-ray ptychography. Ptychography is a lensless method that is being used to image samples through a simultaneous numerical inversion of a large number of diffraction patterns from adjacent overlapping scan positions. This acquisition method can enable nanoscale imaging with x-rays and electrons, but this often requires very large experimental datasets and commensurately high turnaround times, which can limit experimental capabilities such as real-time experimental steering and low-latency monitoring. In this work, we introduce a software system that can automate ptychography data analysis tasks. We accelerate the data analysis pipeline by using a modified version of PtychoNN – an ML-based approach to solve phase retrieval problem that shows two orders of magnitude speedup compared to traditional iterative methods. Further, our system coordinates and overlaps different data analysis tasks to minimize synchronization overhead between different stages of the workflow. We evaluate our workflow system with real-world experimental workloads from the 26ID beamline at Advanced Photon Source and ThetaGPU cluster at Argonne Leadership Computing Resources.

READ FULL TEXT
research
06/20/2023

Closing the loop: Autonomous experiments enabled by machine-learning-based online data analysis in synchrotron beamline environments

Recently, there has been significant interest in applying machine learni...
research
09/20/2022

Deep learning at the edge enables real-time streaming ptychographic imaging

Coherent microscopy techniques provide an unparalleled multi-scale view ...
research
11/22/2021

High-Performance Ptychographic Reconstruction with Federated Facilities

Beamlines at synchrotron light source facilities are powerful scientific...
research
06/13/2022

Towards an Approximation-Aware Computational Workflow Framework for Accelerating Large-Scale Discovery Tasks

The use of approximation is fundamental in computational science. Almost...
research
11/16/2021

Machine Learning-Assisted Analysis of Small Angle X-ray Scattering

Small angle X-ray scattering (SAXS) is extensively used in materials sci...
research
06/22/2021

Real-Time XFEL Data Analysis at SLAC and NERSC: a Trial Run of Nascent Exascale Experimental Data Analysis

X-ray scattering experiments using Free Electron Lasers (XFELs) are a po...
research
03/24/2023

PeakNet: Bragg peak finding in X-ray crystallography experiments with U-Net

Serial crystallography at X-ray free electron laser (XFEL) sources has e...

Please sign up or login with your details

Forgot password? Click here to reset