Adaptive Monte-Carlo Optimization

05/21/2018
by   Vivek Bagaria, et al.
0

The celebrated Monte Carlo method estimates a quantity that is expensive to compute by random sampling. We propose adaptive Monte Carlo optimization: a general framework for discrete optimization of an expensive-to-compute function by adaptive random sampling. Applications of this framework have already appeared in machine learning but are tied to their specific contexts and developed in isolation. We take a unified view and show that the framework has broad applicability by applying it on several common machine learning problems: k-nearest neighbors, hierarchical clustering and maximum mutual information feature selection. On real data we show that this framework allows us to develop algorithms that confer a gain of a magnitude or two over exact computation. We also characterize the performance gain theoretically under regularity assumptions on the data that we verify in real world data. The code is available at https://github.com/govinda-kamath/combinatorial_MAB.

READ FULL TEXT

page 14

page 15

research
09/29/2020

ParaMonte: A high-performance serial/parallel Monte Carlo simulation library for C, C++, Fortran

ParaMonte (standing for Parallel Monte Carlo) is a serial and MPI/Coarra...
research
05/10/2018

Unbiased and Consistent Nested Sampling via Sequential Monte Carlo

We introduce a new class of sequential Monte Carlo methods called Nested...
research
05/03/2023

FastAMI – a Monte Carlo Approach to the Adjustment for Chance in Clustering Comparison Metrics

Clustering is at the very core of machine learning, and its applications...
research
07/03/2021

Adaptive stratified sampling for non-smooth problems

Science and engineering problems subject to uncertainty are frequently b...
research
06/25/2019

Monte Carlo Gradient Estimation in Machine Learning

This paper is a broad and accessible survey of the methods we have at ou...
research
05/07/2021

Deep Learning Hamiltonian Monte Carlo

We generalize the Hamiltonian Monte Carlo algorithm with a stack of neur...
research
10/27/2020

Nonlinear Monte Carlo Method for Imbalanced Data Learning

For basic machine learning problems, expected error is used to evaluate ...

Please sign up or login with your details

Forgot password? Click here to reset