The Data Movement Bottleneck: Theoretical Shortcomings of Analog Optical Fourier Transform and Convolution Computing Accelerators

08/03/2023
by   James T. Meech, et al.
0

Modern computing tasks are constrained to having digital electronic input and output data. Due to these constraints imposed by the user, any analog computing accelerator must perform an analog-to-digital conversion on its input data and a subsequent digital-to-analog conversion on its output data. To avoid this the analog hardware would need to completely replace the full functionality of traditional digital electronic computer hardware. Using 27 empirically-measured benchmarks we estimate that an ideal optical accelerator that accelerates Fourier transforms and convolutions can produce an average speedup of 9.4 times, and a median speedup of 1.9 times for the set of benchmarks. The maximum speedups achieved were 45.3 times for a pure Fourier transform and 159.4 times for a pure convolution. These results show that an optical accelerator only produces significant speedup for applications consisting exclusively of Fourier transforms and convolutions. In addition to the theoretical results we quantify the data movement bottleneck which causes a 23.8 times slowdown in a prototype optical Fourier transform accelerator which we built from widely-available off-the-shelf parts.

READ FULL TEXT

page 6

page 7

research
06/07/2013

OPS-QFTs: A new type of quaternion Fourier transforms based on the orthogonal planes split with one or two general pure quaternions

We explain the orthogonal planes split (OPS) of quaternions based on the...
research
10/16/2018

An Area Efficient 2D Fourier Transform Architecture for FPGA Implementation

Two-dimensional Fourier transform plays a significant role in a variety ...
research
04/10/2017

Integral Transforms from Finite Data: An Application of Gaussian Process Regression to Fourier Analysis

Computing accurate estimates of the Fourier transform of analog signals ...
research
06/23/2020

hxtorch: PyTorch for BrainScaleS-2 – Perceptrons on Analog Neuromorphic Hardware

We present software facilitating the usage of the BrainScaleS-2 analog n...
research
11/16/2016

Spectral Convolution Networks

Previous research has shown that computation of convolution in the frequ...
research
02/20/2023

Optical Transformers

The rapidly increasing size of deep-learning models has caused renewed a...
research
03/30/2023

Hybrid Dealiasing of Complex Convolutions

Efficient algorithms for computing linear convolutions based on the fast...

Please sign up or login with your details

Forgot password? Click here to reset