PROTES: Probabilistic Optimization with Tensor Sampling

01/28/2023
by   Anastasia Batsheva, et al.
0

We develop new method PROTES for optimization of the multidimensional arrays and discretized multivariable functions, which is based on a probabilistic sampling from a probability density function given in the low-parametric tensor train format. We tested it on complex multidimensional arrays taken, among other, from real-world applications, including unconstrained binary optimization and optimal control problems, for which the possible number of elements is up to 2^100 elements. In numerical experiments, both on analytic model functions and on complex problems, our algorithm outperform existing popular discrete optimization methods (Particle Swarm Optimization, Covariance Matrix Adaptation, Differential Evolution and others). Moreover, we take the same set of hyperparameters of our algorithm for all numerical applications.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/29/2022

Optimization of Functions Given in the Tensor Train Format

Tensor train (TT) format is a common approach for computationally effici...
research
08/05/2022

Black box approximation in the tensor train format initialized by ANOVA decomposition

Surrogate models can reduce computational costs for multivariable functi...
research
04/30/2022

TTOpt: A Maximum Volume Quantized Tensor Train-based Optimization and its Application to Reinforcement Learning

We present a novel procedure for optimization based on the combination o...
research
02/16/2021

Solution of the Fokker-Planck equation by cross approximation method in the tensor train format

We propose the novel numerical scheme for solution of the multidimension...
research
01/03/2018

Gradient-based Optimization for Regression in the Functional Tensor-Train Format

We consider the task of low-multilinear-rank functional regression, i.e....
research
11/12/2013

DinTucker: Scaling up Gaussian process models on multidimensional arrays with billions of elements

Infinite Tucker Decomposition (InfTucker) and random function prior mode...
research
06/08/2022

Constructive TT-representation of the tensors given as index interaction functions with applications

This paper presents a method to build explicit tensor-train (TT) represe...

Please sign up or login with your details

Forgot password? Click here to reset