Approximate message passing from random initialization with applications to ℤ_2 synchronization

02/07/2023
by   Gen Li, et al.
0

This paper is concerned with the problem of reconstructing an unknown rank-one matrix with prior structural information from noisy observations. While computing the Bayes-optimal estimator seems intractable in general due to its nonconvex nature, Approximate Message Passing (AMP) emerges as an efficient first-order method to approximate the Bayes-optimal estimator. However, the theoretical underpinnings of AMP remain largely unavailable when it starts from random initialization, a scheme of critical practical utility. Focusing on a prototypical model called ℤ_2 synchronization, we characterize the finite-sample dynamics of AMP from random initialization, uncovering its rapid global convergence. Our theory provides the first non-asymptotic characterization of AMP in this model without requiring either an informative initialization (e.g., spectral initialization) or sample splitting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2022

A Non-Asymptotic Framework for Approximate Message Passing in Spiked Models

Approximate message passing (AMP) emerges as an effective iterative para...
research
10/05/2021

Approximate Message Passing for orthogonally invariant ensembles: Multivariate non-linearities and spectral initialization

We study a class of Approximate Message Passing (AMP) algorithms for sym...
research
06/04/2021

PCA Initialization for Approximate Message Passing in Rotationally Invariant Models

We study the problem of estimating a rank-1 signal in the presence of ro...
research
03/30/2022

Fast, Accurate and Memory-Efficient Partial Permutation Synchronization

Previous partial permutation synchronization (PPS) algorithms, which are...
research
06/21/2021

Local convexity of the TAP free energy and AMP convergence for Z2-synchronization

We study mean-field variational Bayesian inference using the TAP approac...
research
06/08/2018

Approximate Message Passing for Amplitude Based Optimization

We consider an ℓ_2-regularized non-convex optimization problem for recov...
research
10/14/2016

Message-passing algorithms for synchronization problems over compact groups

Various alignment problems arising in cryo-electron microscopy, communit...

Please sign up or login with your details

Forgot password? Click here to reset