A generic and fast C++ optimization framework

11/17/2017
by   Ryan R. Curtin, et al.
0

The development of the mlpack C++ machine learning library (http://www.mlpack.org/) has required the design and implementation of a flexible, robust optimization system that is able to solve the types of arbitrary optimization problems that may arise all throughout machine learning problems. In this paper, we present the generic optimization framework that we have designed for mlpack. A key priority in the design was ease of implementation of both new optimizers and new objective functions to be optimized; therefore, implementation of a new optimizer requires only one method and implementation of a new objective function requires at most four functions. This leads to simple and intuitive code, which, for fast prototyping and experimentation, is of paramount importance. When compared to optimization frameworks of other libraries, we find that mlpack's supports more types of objective functions, is able to make optimizations that other frameworks do not, and seamlessly supports user-defined objective functions and optimizers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/22/2018

ensmallen: a flexible C++ library for efficient function optimization

We present ensmallen, a fast and flexible C++ library for mathematical o...
research
03/10/2017

Deep Sets

In this paper, we study the problem of designing objective functions for...
research
12/07/2018

The Modeling of SDL Aiming at Knowledge Acquisition in Automatic Driving

In this paper we proposed an ultimate theory to solve the multi-target c...
research
03/09/2020

Flexible numerical optimization with ensmallen

This report provides an introduction to the ensmallen numerical optimiza...
research
08/30/2021

The ensmallen library for flexible numerical optimization

We overview the ensmallen numerical optimization library, which provides...
research
09/16/2019

Fast Large-Scale Discrete Optimization Based on Principal Coordinate Descent

Binary optimization, a representative subclass of discrete optimization,...
research
08/28/2019

Machine-learning techniques for the optimal design of acoustic metamaterials

Recently, an increasing research effort has been dedicated to analyse th...

Please sign up or login with your details

Forgot password? Click here to reset