Optimization for Classical Machine Learning Problems on the GPU

03/30/2022
by   Sören Laue, et al.
0

Constrained optimization problems arise frequently in classical machine learning. There exist frameworks addressing constrained optimization, for instance, CVXPY and GENO. However, in contrast to deep learning frameworks, GPU support is limited. Here, we extend the GENO framework to also solve constrained optimization problems on the GPU. The framework allows the user to specify constrained optimization problems in an easy-to-read modeling language. A solver is then automatically generated from this specification. When run on the GPU, the solver outperforms state-of-the-art approaches like CVXPY combined with a GPU-accelerated solver such as cuOSQP or SCS by a few orders of magnitude.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/31/2019

GENO -- GENeric Optimization for Classical Machine Learning

Although optimization is the longstanding algorithmic backbone of machin...
research
06/25/2021

Linear solvers for power grid optimization problems: a review of GPU-accelerated linear solvers

The linear equations that arise in interior methods for constrained opti...
research
11/27/2021

NCVX: A User-Friendly and Scalable Package for Nonconvex Optimization in Machine Learning

Optimizing nonconvex (NCVX) problems, especially nonsmooth and constrain...
research
11/02/2020

AnyMOD.jl: A Julia package for creating energy system models

AnyMOD.jl is a Julia framework for creating large-scale energy system mo...
research
11/22/2022

OptiRica: Towards an Efficient Optimizing Horn Solver

This paper describes an ongoing effort to develop an optimizing version ...
research
09/01/2020

PYCSP3: Modeling Combinatorial Constrained Problems in Python

In this document, we introduce PYCSP3, a Python library that allows us t...
research
05/01/2023

Augmented Electronic Ising Machine as an Effective SAT Solver

With the slowdown of improvement in conventional von Neumann systems, in...

Please sign up or login with your details

Forgot password? Click here to reset