Julia Implementation of the Dynamic Distributed Dimensional Data Model

08/14/2016
by   Alexander Chen, et al.
0

Julia is a new language for writing data analysis programs that are easy to implement and run at high performance. Similarly, the Dynamic Distributed Dimensional Data Model (D4M) aims to clarify data analysis operations while retaining strong performance. D4M accomplishes these goals through a composable, unified data model on associative arrays. In this work, we present an implementation of D4M in Julia and describe how it enables and facilitates data analysis. Several experiments showcase scalable performance in our new Julia version as compared to the original Matlab implementation.

READ FULL TEXT

page 5

page 6

research
09/01/2022

Python Implementation of the Dynamic Distributed Dimensional Data Model

Python has become a standard scientific computing language with fast-gro...
research
09/24/2016

Benchmarking SciDB Data Import on HPC Systems

SciDB is a scalable, computational database management system that uses ...
research
02/03/2019

A Billion Updates per Second Using 30,000 Hierarchical In-Memory D4M Databases

Analyzing large scale networks requires high performance streaming updat...
research
07/06/2019

Streaming 1.9 Billion Hypersparse Network Updates per Second with D4M

The Dynamic Distributed Dimensional Data Model (D4M) library implements ...
research
08/04/2014

A Moving Least Squares Based Approach for Contour Visualization of Multi-Dimensional Data

Analysis of high dimensional data is a common task. Often, small multipl...
research
08/25/2018

Hyperscaling Internet Graph Analysis with D4M on the MIT SuperCloud

Detecting anomalous behavior in network traffic is a major challenge due...
research
02/12/2019

High dimensionality: The latest challenge to data analysis

The advent of modern technology, permitting the measurement of thousands...

Please sign up or login with your details

Forgot password? Click here to reset