DeepAI AI Chat
Log In Sign Up

Algorithmic Obstructions in the Random Number Partitioning Problem

by   David Gamarnik, et al.

We consider the algorithmic problem of finding a near-optimal solution for the number partitioning problem (NPP). The NPP appears in many applications, including the design of randomized controlled trials, multiprocessor scheduling, and cryptography; and is also of theoretical significance. It possesses a so-called statistical-to-computational gap: when its input X has distribution 𝒩(0,I_n), its optimal value is Θ(√(n)2^-n) w.h.p.; whereas the best polynomial-time algorithm achieves an objective value of only 2^-Θ(log^2 n), w.h.p. In this paper, we initiate the study of the nature of this gap. Inspired by insights from statistical physics, we study the landscape of NPP and establish the presence of the Overlap Gap Property (OGP), an intricate geometric property which is known to be a rigorous evidence of an algorithmic hardness for large classes of algorithms. By leveraging the OGP, we establish that (a) any sufficiently stable algorithm, appropriately defined, fails to find a near-optimal solution with energy below 2^-ω(n log^-1/5 n); and (b) a very natural MCMC dynamics fails to find near-optimal solutions. Our simulations suggest that the state of the art algorithm achieving 2^-Θ(log^2 n) is indeed stable, but formally verifying this is left as an open problem. OGP regards the overlap structure of m-tuples of solutions achieving a certain objective value. When m is constant we prove the presence of OGP in the regime 2^-Θ(n), and the absence of it in the regime 2^-o(n). Interestingly, though, by considering overlaps with growing values of m we prove the presence of the OGP up to the level 2^-ω(√(nlog n)). Our proof of the failure of stable algorithms at values 2^-ω(n log^-1/5 n) employs methods from Ramsey Theory from the extremal combinatorics, and is of independent interest.


page 1

page 2

page 3

page 4

∙ 04/15/2019

The Landscape of the Planted Clique Problem: Dense subgraphs and the Overlap Gap Property

In this paper we study the computational-statistical gap of the planted ...
∙ 08/01/2021

The Overlap Gap Property: a Geometric Barrier to Optimizing over Random Structures

The problem of optimizing over random structures emerges in many areas o...
∙ 10/06/2022

Random Max-CSPs Inherit Algorithmic Hardness from Spin Glasses

We study random constraint satisfaction problems (CSPs) in the unsatisfi...
∙ 02/13/2023

Geometric Barriers for Stable and Online Algorithms for Discrepancy Minimization

For many computational problems involving randomness, intricate geometri...
∙ 08/26/2019

The Overlap Gap Property in Principal Submatrix Recovery

We study support recovery for a k × k principal submatrix with elevated ...
∙ 03/29/2022

Algorithms and Barriers in the Symmetric Binary Perceptron Model

The symmetric binary perceptron () exhibits a dramatic statistical-to-co...
∙ 04/25/2020

Low-Degree Hardness of Random Optimization Problems

We consider the problem of finding nearly optimal solutions of optimizat...