Simulating Execution Time of Tensor Programs using Graph Neural Networks

04/26/2019
by   Jakub M. Tomczak, et al.
0

Optimizing the execution time of tensor program, e.g., a convolution, involves finding its optimal configuration. Searching the configuration space exhaustively is typically infeasible in practice. In line with recent research using TVM, we propose to learn a surrogate model to overcome this issue. The model is trained on an acyclic graph called an abstract syntax tree, and utilizes a graph convolutional network to exploit structure in the graph. We claim that a learnable graph-based data processing is a strong competitor to heuristic-based feature extraction. We present a new dataset of graphs corresponding to configurations and their execution time for various tensor programs. We provide baselines for a runtime prediction task.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/09/2022

Machine Learning-based Selection of Graph Partitioning Strategy Using the Characteristics of Graph Data and Algorithm

Analyzing large graph data is an essential part of many modern applicati...
research
09/19/2018

FastDeepIoT: Towards Understanding and Optimizing Neural Network Execution Time on Mobile and Embedded Devices

Deep neural networks show great potential as solutions to many sensing a...
research
05/15/2020

HeCSON: Heuristic for Configuration Selectionin Optical Network Planning

We present a transceiver configuration selection heuristic combining Enh...
research
04/13/2020

Detecting Straggler MapReduce Tasks in Big Data Processing Infrastructure by Neural Network

Straggler task detection is one of the main challenges in applying MapRe...
research
07/30/2020

New approach to MPI program execution time prediction

The problem of MPI programs execution time prediction on a certain set o...
research
02/15/2021

Network of Tensor Time Series

Co-evolving time series appears in a multitude of applications such as e...
research
04/10/2017

ROSA: R Optimizations with Static Analysis

R is a popular language and programming environment for data scientists....

Please sign up or login with your details

Forgot password? Click here to reset