A Distributed Learning Architecture for Scientific Imaging Problems

by   A. Panousopoulou, et al.
Foundation for Research & Technology-Hellas (FORTH)

Current trends in scientific imaging are challenged by the emerging need of integrating sophisticated machine learning with Big Data analytics platforms. This work proposes an in-memory distributed learning architecture for enabling sophisticated learning and optimization techniques on scientific imaging problems, which are characterized by the combination of variant information from different origins. We apply the resulting, Spark-compliant, architecture on two emerging use cases from the scientific imaging domain, namely: (a) the space variant deconvolution of galaxy imaging surveys (astrophysics), (b) the super-resolution based on coupled dictionary training (remote sensing). We conduct evaluation studies considering relevant datasets, and the results report at least 60% improvement in time response against the conventional computing solutions. Ultimately, the offered discussion provides useful practical insights on the impact of key Spark tuning parameters on the speedup achieved, and the memory/disk footprint.


page 1

page 2

page 3

page 4


EVEREST: A design environment for extreme-scale big data analytics on heterogeneous platforms

High-Performance Big Data Analytics (HPDA) applications are characterize...

Multi-Frame Super-Resolution Reconstruction with Applications to Medical Imaging

The optical resolution of a digital camera is one of its most crucial pa...

Multi-source imagery fusion using deep learning in a cloud computing platform

Given the high availability of data collected by different remote sensin...

Deep learning in ultrasound imaging

We consider deep learning strategies in ultrasound systems, from the fro...

Towards a Dynamic Composability Approach for using Heterogeneous Systems in Remote Sensing

Influenced by the advances in data and computing, the scientific practic...

Deriving a Quantitative Relationship Between Resolution and Human Classification Error

For machine learning perception problems, human-level classification per...

Intelligent Biohybrid Neurotechnologies: Are They Really What They Claim?

In the era of intelligent biohybrid neurotechnologies for brain repair, ...

Please sign up or login with your details

Forgot password? Click here to reset