DeepAI AI Chat
Log In Sign Up

SGDLibrary: A MATLAB library for stochastic gradient descent algorithms

by   Hiroyuki Kasai, et al.
University of Electro-Communications

We consider the problem of finding the minimizer of a function f: R^d →R of the form f(w) = 1/n∑_if_i(w). This problem has been studied intensively in recent years in machine learning research field. One typical but promising approach for large-scale data is stochastic optimization algorithm. SGDLibrary is a flexible, extensible and efficient pure-Matlab library of a collection of stochastic optimization algorithms. The purpose of the library is to provide researchers and implementers a comprehensive evaluation environment of those algorithms on various machine learning problems.


page 11

page 12

page 13

page 14

page 17

page 18

page 19

page 21


A Latent Variational Framework for Stochastic Optimization

This paper provides a unifying theoretical framework for stochastic opti...

Adaptive Sequential Machine Learning

A framework previously introduced in [3] for solving a sequence of stoch...

Active Probabilistic Inference on Matrices for Pre-Conditioning in Stochastic Optimization

Pre-conditioning is a well-known concept that can significantly improve ...

Target-based Surrogates for Stochastic Optimization

We consider minimizing functions for which it is expensive to compute th...