Effective Parallelisation for Machine Learning

10/08/2018
by   Michael Kamp, et al.
0

We present a novel parallelisation scheme that simplifies the adaptation of learning algorithms to growing amounts of data as well as growing needs for accurate and confident predictions in critical applications. In contrast to other parallelisation techniques, it can be applied to a broad class of learning algorithms without further mathematical derivations and without writing dedicated code, while at the same time maintaining theoretical performance guarantees. Moreover, our parallelisation scheme is able to reduce the runtime of many learning algorithms to polylogarithmic time on quasi-polynomially many processing units. This is a significant step towards a general answer to an open question on the efficient parallelisation of machine learning algorithms in the sense of Nick's Class (NC). The cost of this parallelisation is in the form of a larger sample complexity. Our empirical study confirms the potential of our parallelisation scheme with fixed numbers of processors and instances in realistic application scenarios.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/08/2022

Parallelization of Machine Learning Algorithms Respectively on Single Machine and Spark

With the rapid development of big data technologies, how to dig out usef...
research
09/20/2020

The Ultimate DataFlow for Ultimate SuperComputers-on-a-Chips

This article starts from the assumption that near future 100BTransistor ...
research
06/01/2020

When Machine Learning Meets Multiscale Modeling in Chemical Reactions

Due to the intrinsic complexity and nonlinearity of chemical reactions, ...
research
07/09/2020

Making learning more transparent using conformalized performance prediction

In this work, we study some novel applications of conformal inference te...
research
06/06/2011

Using More Data to Speed-up Training Time

In many recent applications, data is plentiful. By now, we have a rather...
research
06/07/2021

Launchpad: A Programming Model for Distributed Machine Learning Research

A major driver behind the success of modern machine learning algorithms ...
research
10/07/2020

Exploiting non-i.i.d. data towards more robust machine learning algorithms

In the field of machine learning there is a growing interest towards mor...

Please sign up or login with your details

Forgot password? Click here to reset