DeepAI AI Chat
Log In Sign Up

SGDLibrary: A MATLAB library for stochastic gradient descent algorithms

10/27/2017
by   Hiroyuki Kasai, et al.
University of Electro-Communications
0

We consider the problem of finding the minimizer of a function f: R^d →R of the form f(w) = 1/n∑_if_i(w). This problem has been studied intensively in recent years in machine learning research field. One typical but promising approach for large-scale data is stochastic optimization algorithm. SGDLibrary is a flexible, extensible and efficient pure-Matlab library of a collection of stochastic optimization algorithms. The purpose of the library is to provide researchers and implementers a comprehensive evaluation environment of those algorithms on various machine learning problems.

READ FULL TEXT

page 11

page 12

page 13

page 14

page 17

page 18

page 19

page 21

05/05/2019

A Latent Variational Framework for Stochastic Optimization

This paper provides a unifying theoretical framework for stochastic opti...
04/04/2019

Adaptive Sequential Machine Learning

A framework previously introduced in [3] for solving a sequence of stoch...
02/20/2019

Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization

Pre-conditioning is a well-known concept that can significantly improve ...
02/06/2023

Target-based Surrogates for Stochastic Optimization

We consider minimizing functions for which it is expensive to compute th...