Bridge Data Center AI Systems with Edge Computing for Actionable Information Retrieval

05/28/2021
by   Zhengchun Liu, et al.
11

Extremely high data rates at modern synchrotron and X-ray free-electron lasers (XFELs) light source beamlines motivate the use of machine learning methods for data reduction, feature detection, and other purposes. Regardless of the application, the basic concept is the same: data collected in early stages of an experiment, data from past similar experiments, and/or data simulated for the upcoming experiment are used to train machine learning models that, in effect, learn specific characteristics of those data; these models are then used to process subsequent data more efficiently than would general-purpose models that lack knowledge of the specific dataset or data class. Thus, a key challenge is to be able to train models with sufficient rapidity that they can be deployed and used within useful timescales. We describe here how specialized data center AI systems can be used for this purpose.

READ FULL TEXT
research
11/12/2018

Characterizing machine learning process: A maturity framework

Academic literature on machine learning modeling fails to address how to...
research
03/18/2023

A general-purpose AI assistant embedded in an open-source radiology information system

Radiology AI models have made significant progress in near-human perform...
research
01/27/2022

Electrical Load Forecasting Using Edge Computing and Federated Learning

In the smart grid, huge amounts of consumption data are used to train de...
research
02/15/2021

A Data Quality-Driven View of MLOps

Developing machine learning models can be seen as a process similar to t...
research
01/16/2023

PlasmoFAB: A Benchmark to Foster Machine Learning for Plasmodium falciparum Protein Antigen Candidate Prediction

Motivation: Machine learning methods can be used to support scientific d...
research
11/24/2018

Deep Learning Inference in Facebook Data Centers: Characterization, Performance Optimizations and Hardware Implications

The application of deep learning techniques resulted in remarkable impro...
research
06/18/2022

Reduced Robust Random Cut Forest for Out-Of-Distribution detection in machine learning models

Most machine learning-based regressors extract information from data col...

Please sign up or login with your details

Forgot password? Click here to reset