Accelerated Convolutions for Efficient Multi-Scale Time to Contact Computation in Julia

12/28/2016
by   Alexander Amini, et al.
0

Convolutions have long been regarded as fundamental to applied mathematics, physics and engineering. Their mathematical elegance allows for common tasks such as numerical differentiation to be computed efficiently on large data sets. Efficient computation of convolutions is critical to artificial intelligence in real-time applications, like machine vision, where convolutions must be continuously and efficiently computed on tens to hundreds of kilobytes per second. In this paper, we explore how convolutions are used in fundamental machine vision applications. We present an accelerated n-dimensional convolution package in the high performance computing language, Julia, and demonstrate its efficacy in solving the time to contact problem for machine vision. Results are measured against synthetically generated videos and quantitatively assessed according to their mean squared error from the ground truth. We achieve over an order of magnitude decrease in compute time and allocated memory for comparable machine vision applications. All code is packaged and integrated into the official Julia Package Manager to be used in various other scenarios.

READ FULL TEXT

page 3

page 6

research
08/05/2018

3D Depthwise Convolution: Reducing Model Parameters in 3D Vision Tasks

Standard 3D convolution operations require much larger amounts of memory...
research
07/30/2022

Robust Contact State Estimation in Humanoid Walking Gaits

In this article, we propose a deep learning framework that provides a un...
research
12/02/2020

Sparse Convolutions on Continuous Domains for Point Cloud and Event Stream Networks

Image convolutions have been a cornerstone of a great number of deep lea...
research
09/04/2022

Computing Generalized Convolutions Faster Than Brute Force

In this paper, we consider a general notion of convolution. Let D be a f...
research
04/23/2021

Skip-Convolutions for Efficient Video Processing

We propose Skip-Convolutions to leverage the large amount of redundancie...
research
04/04/2023

Neural Field Convolutions by Repeated Differentiation

Neural fields are evolving towards a general-purpose continuous represen...
research
02/26/2021

Beyond Convolutions: A Novel Deep Learning Approach for Raw Seismic Data Ingestion

Traditional seismic processing workflows (SPW) are expensive, requiring ...

Please sign up or login with your details

Forgot password? Click here to reset