Local Energy Distribution Based Hyperparameter Determination for Stochastic Simulated Annealing

04/24/2023
by   Naoya Onizawa, et al.
0

This paper presents a local energy distribution based hyperparameter determination for stochastic simulated annealing (SSA). SSA is capable of solving combinatorial optimization problems faster than typical simulated annealing (SA), but requires a time-consuming hyperparameter search. The proposed method determines hyperparameters based on the local energy distributions of spins (probabilistic bits). The spin is a basic computing element of SSA and is graphically connected to other spins with its weights. The distribution of the local energy can be estimated based on the central limit theorem (CLT). The CLT-based normal distribution is used to determine the hyperparameters, which reduces the time complexity for hyperparameter search from O(n^3) of the conventional method to O(1). The performance of SSA with the determined hyperparameters is evaluated on the Gset and K2000 benchmarks for maximum-cut problems. The results show that the proposed method achieves mean cut values of approximately 98

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/26/2018

Stochastic Hyperparameter Optimization through Hypernetworks

Machine learning models are often tuned by nesting optimization of model...
research
07/17/2022

Supplementing Recurrent Neural Networks with Annealing to Solve Optimization Problems

Combinatorial optimization problems can be solved by heuristic algorithm...
research
07/27/2018

GPU Based Parallel Ising Computing for Combinatorial Optimization Problems in VLSI Physical Design

In this work, we explore the Ising spin glass model as a solution method...
research
08/14/2020

Efficient hyperparameter optimization by way of PAC-Bayes bound minimization

Identifying optimal values for a high-dimensional set of hyperparameters...
research
08/16/2019

Search Algorithms for Mastermind

his paper presents two novel approaches to solving the classic board gam...
research
03/06/2013

A Probabilistic Algorithm for Calculating Structure: Borrowing from Simulated Annealing

We have developed a general Bayesian algorithm for determining the coord...
research
11/08/2019

Comparison of D-Wave Quantum Annealing and Classical Simulated Annealing for Local Minima Determination

Restricted Boltzmann Machines trained with different numbers of iteratio...

Please sign up or login with your details

Forgot password? Click here to reset