Massively Parallel Causal Inference of Whole Brain Dynamics at Single Neuron Resolution

by   Wassapon Watanakeesuntorn, et al.

Empirical Dynamic Modeling (EDM) is a nonlinear time series causal inference framework. The latest implementation of EDM, cppEDM, has only been used for small datasets due to computational cost. With the growth of data collection capabilities, there is a great need to identify causal relationships in large datasets. We present mpEDM, a parallel distributed implementation of EDM optimized for modern GPU-centric supercomputers. We improve the original algorithm to reduce redundant computation and optimize the implementation to fully utilize hardware resources such as GPUs and SIMD units. As a use case, we run mpEDM on AI Bridging Cloud Infrastructure (ABCI) using datasets of an entire animal brain sampled at single neuron resolution to identify dynamical causation patterns across the brain. mpEDM is 1,530 X faster than cppEDM and a dataset containing 101,729 neuron was analyzed in 199 seconds on 512 nodes. This is the largest EDM causal inference achieved to date.



page 9


ZaliQL: A SQL-Based Framework for Drawing Causal Inference from Big Data

Causal inference from observational data is a subject of active research...

kEDM: A Performance-portable Implementation of Empirical Dynamic Modeling using Kokkos

Empirical Dynamic Modeling (EDM) is a state-of-the-art non-linear time-s...

Causal inference for temporal patterns

Complex dynamical systems are prevalent in many scientific disciplines. ...

Causal Inference in Network Economics

Network economics is the study of a rich class of equilibrium problems t...

Causal inference for cloud computing

Cloud computing involves complex technical and economical systems and in...

User-Oriented Smart General AI System under Causal Inference

General AI system solves a wide range of tasks with high performance in ...

AI Assurance using Causal Inference: Application to Public Policy

Developing and implementing AI-based solutions help state and federal go...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.