DeepAI AI Chat
Log In Sign Up

Accelerating Domain-aware Deep Learning Models with Distributed Training

by   Aishwarya Sarkar, et al.
Iowa State University of Science and Technology

Recent advances in data-generating techniques led to an explosive growth of geo-spatiotemporal data. In domains such as hydrology, ecology, and transportation, interpreting the complex underlying patterns of spatiotemporal interactions with the help of deep learning techniques hence becomes the need of the hour. However, applying deep learning techniques without domain-specific knowledge tends to provide sub-optimal prediction performance. Secondly, training such models on large-scale data requires extensive computational resources. To eliminate these challenges, we present a novel distributed domain-aware spatiotemporal network that utilizes domain-specific knowledge with improved model performance. Our network consists of a pixel-contribution block, a distributed multiheaded multichannel convolutional (CNN) spatial block, and a recurrent temporal block. We choose flood prediction in hydrology as a use case to test our proposed method. From our analysis, the network effectively predicts high peaks in discharge measurements at watershed outlets with up to 4.1x speedup and increased prediction performance of up to 93%. Our approach achieved a 12.6x overall speedup and increased the mean prediction performance by 16%. We perform extensive experiments on a dataset of 23 watersheds in a northern state of the U.S. and present our findings.


page 1

page 2

page 3

page 4


Deep Multi-View Spatial-Temporal Network for Taxi Demand Prediction

Taxi demand prediction is an important building block to enabling intell...

Communication-Efficient Distributed Deep Learning: Survey, Evaluation, and Challenges

In recent years, distributed deep learning techniques are widely deploye...

Accelerating Data Loading in Deep Neural Network Training

Data loading can dominate deep neural network training time on large-sca...

STAU: A SpatioTemporal-Aware Unit for Video Prediction and Beyond

Video prediction aims to predict future frames by modeling the complex s...

Transfer Learning Approaches for Knowledge Discovery in Grid-based Geo-Spatiotemporal Data

Extracting and meticulously analyzing geo-spatiotemporal features is cru...

Variational Attention: Propagating Domain-Specific Knowledge for Multi-Domain Learning in Crowd Counting

In crowd counting, due to the problem of laborious labelling, it is perc...

DADNN: Multi-Scene CTR Prediction via Domain-Aware Deep Neural Network

Click through rate(CTR) prediction is a core task in advertising systems...