DeepAI AI Chat
Log In Sign Up

Nanosurveyor: a framework for real-time data processing

by   Benedikt J. Daurer, et al.
Uppsala universitet
Berkeley Lab

Scientists are drawn to synchrotrons and accelerator based light sources because of their brightness, coherence and flux. The rate of improvement in brightness and detector technology has outpaced Moore's law growth seen for computers, networks, and storage, and is enabling novel observations and discoveries with faster frame rates, larger fields of view, higher resolution, and higher dimensionality. Here we present an integrated software/algorithmic framework designed to capitalize on high throughput experiments, and describe the streamlined processing pipeline of ptychography data analysis. The pipeline provides throughput, compression, and resolution as well as rapid feedback to the microscope operators.


L3: Accelerator-Friendly Lossless Image Format for High-Resolution, High-Throughput DNN Training

The training process of deep neural networks (DNNs) is usually pipelined...

Real-time Text Analytics Pipeline Using Open-source Big Data Tools

Real-time text processing systems are required in many domains to quickl...

A Pipeline for Integrated Theory and Data-Driven Modeling of Genomic and Clinical Data

High throughput genome sequencing technologies such as RNA-Seq and Micro...

Machine learning enabling high-throughput and remote operations at large-scale user facilities

Imaging, scattering, and spectroscopy are fundamental in understanding a...

TurboLoRa: enhancing LoRaWAN data rate via device synchronization

Over the last few years we have witnessed an exponential growth in the a...

An Adapter Architecture for Heterogeneous Data Processing in Bioinformatics Pipelines

Bioinformatics is a growing field focused on both the domains of compute...