Novel Matrix Hit and Run for Sampling Polytopes and Its GPU Implementation

04/14/2021
by   Mario Vazquez Corte, et al.
0

We propose and analyze a new Markov Chain Monte Carlo algorithm that generates a uniform sample over full and non-full dimensional polytopes. This algorithm, termed "Matrix Hit and Run" (MHAR), is a modification of the Hit and Run framework. For the regime n^1+1/3≪ m, MHAR has a lower asymptotic cost per sample in terms of soft-O notation () than do existing sampling algorithms after a warm start. MHAR is designed to take advantage of matrix multiplication routines that require less computational and memory resources. Our tests show this implementation to be substantially faster than the hitandrun R package, especially for higher dimensions. Finally, we provide a python library based on Pytorch and a Colab notebook with the implementation ready for deployment in architectures with GPU or just CPU.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/20/2019

An Introduction to Markov Chain Monte Carlo on Finite State Spaces

We elaborate the idea behind Markov chain Monte Carlo (MCMC) methods in ...
research
04/08/2019

A Fast Scheme for the Uniform Sampling of Binary Matrices with Fixed Margins

Uniform sampling of binary matrix with fixed margins is an important and...
research
04/08/2019

A Fast MCMC for the Uniform Sampling of Binary Matrices with Fixed Margins

Uniform sampling of binary matrix with fixed margins is an important and...
research
08/21/2023

Monte Carlo on manifolds in high dimensions

We introduce an efficient numerical implementation of a Markov Chain Mon...
research
12/30/2019

Dynamic Gauss Newton Metropolis Algorithm

GNM: The MCMC Jagger. A rocking awesome sampler. This python package is ...
research
02/24/2020

Optimizing High Performance Markov Clustering for Pre-Exascale Architectures

HipMCL is a high-performance distributed memory implementation of the po...
research
06/06/2023

Towards Memory-Efficient Training for Extremely Large Output Spaces – Learning with 500k Labels on a Single Commodity GPU

In classification problems with large output spaces (up to millions of l...

Please sign up or login with your details

Forgot password? Click here to reset