Nanosurveyor: a framework for real-time data processing

09/09/2016
by   Benedikt J. Daurer, et al.
0

Scientists are drawn to synchrotrons and accelerator based light sources because of their brightness, coherence and flux. The rate of improvement in brightness and detector technology has outpaced Moore's law growth seen for computers, networks, and storage, and is enabling novel observations and discoveries with faster frame rates, larger fields of view, higher resolution, and higher dimensionality. Here we present an integrated software/algorithmic framework designed to capitalize on high throughput experiments, and describe the streamlined processing pipeline of ptychography data analysis. The pipeline provides throughput, compression, and resolution as well as rapid feedback to the microscope operators.

READ FULL TEXT
research
08/18/2022

L3: Accelerator-Friendly Lossless Image Format for High-Resolution, High-Throughput DNN Training

The training process of deep neural networks (DNNs) is usually pipelined...
research
12/12/2017

Real-time Text Analytics Pipeline Using Open-source Big Data Tools

Real-time text processing systems are required in many domains to quickl...
research
05/05/2020

A Pipeline for Integrated Theory and Data-Driven Modeling of Genomic and Clinical Data

High throughput genome sequencing technologies such as RNA-Seq and Micro...
research
01/09/2022

Machine learning enabling high-throughput and remote operations at large-scale user facilities

Imaging, scattering, and spectroscopy are fundamental in understanding a...
research
10/22/2020

TurboLoRa: enhancing LoRaWAN data rate via device synchronization

Over the last few years we have witnessed an exponential growth in the a...
research
10/17/2022

Statistics of High-Throughput Characterization of Microbial Interactions

An active area of research interest is the inference of ecological model...

Please sign up or login with your details

Forgot password? Click here to reset