How deep the machine learning can be

by   János Végh, et al.

Today we live in the age of artificial intelligence and machine learning; from small startups to HW or SW giants, everyone wants to build machine intelligence chips, applications. The task, however, is hard: not only because of the size of the problem: the technology one can utilize (and the paradigm it is based upon) strongly degrades the chances to succeed efficiently. Today the single-processor performance practically reached the limits the laws of nature enable. The only feasible way to achieve the needed high computing performance seems to be parallelizing many sequentially working units. The laws of the (massively) parallelized computing, however, are different from those experienced in connection with assembling and utilizing systems comprising just-a-few single processors. As machine learning is mostly based on the conventional computing (processors), we scrutinize the (known, but somewhat faded) laws of the parallel computing, concerning AI. This paper attempts to review some of the caveats, especially concerning scaling the computing performance of the AI solutions.



There are no comments yet.


page 6

page 24


Which scaling rule applies to Artificial Neural Networks

Although Artificial Neural Networks are biology-mimicking systems, they ...

On the spatiotemporal behavior in biology-mimicking computing systems

The payload performance of conventional computing systems, from single p...

Man and Machine: Questions of Risk, Trust and Accountability in Today's AI Technology

Artificial Intelligence began as a field probing some of the most fundam...

Foreword: A Computable Universe, Understanding Computation and Exploring Nature As Computation

I am most honoured to have the privilege to present the Foreword to this...

The performance wall of parallelized sequential computing: the dark performance and the roofline of performance gain

The computing performance today is developing mainly using parallelized ...

Graphcore C2 Card performance for image-based deep learning application: A Report

Recently, Graphcore has introduced an IPU Processor for accelerating mac...

A Game of Dice: Machine Learning and the Question Concerning Art

We review some practical and philosophical questions raised by the use o...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.