Asymptotic Analysis of ADMM for Compressed Sensing

09/17/2020
by   Ryo Hayakawa, et al.
0

In this paper, we analyze the asymptotic behavior of alternating direction method of multipliers (ADMM) for compressed sensing, where we reconstruct an unknown structured signal from its underdetermined linear measurements. The analytical tool used in this paper is recently developed convex Gaussian min-max theorem (CGMT), which can be applied to various convex optimization problems to obtain its asymptotic error performance. In our analysis of ADMM, we analyze the convex subproblem in the update of ADMM and characterize the asymptotic distribution of the tentative estimate obtained at each iteration. The result shows that the update equations in ADMM can be decoupled into a scalar-valued stochastic process in the asymptotic regime with the large system limit. From the asymptotic result, we can predict the evolution of the error (e.g. mean-square-error (MSE) and symbol error rate (SER)) in ADMM for large-scale compressed sensing problems. Simulation results show that the empirical performance of ADMM and its theoretical prediction are close to each other in sparse vector reconstruction and binary vector reconstruction.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/18/2021

Error Analysis of Douglas-Rachford Algorithm for Linear Inverse Problems: Asymptotics of Proximity Operator for Squared Loss

Proximal splitting-based convex optimization is a promising approach to ...
research
09/28/2020

Noise Variance Estimation Using Asymptotic Residual in Compressed Sensing

In compressed sensing, the measurement is usually contaminated by additi...
research
09/25/2022

Equivalence of state equations from different methods in High-dimensional Regression

State equations (SEs) were firstly introduced in the approximate message...
research
04/04/2020

A Machine Learning Based Framework for the Smart Healthcare Monitoring

In this paper, we propose a novel framework for the smart healthcare sys...
research
05/16/2017

Learning Convex Regularizers for Optimal Bayesian Denoising

We propose a data-driven algorithm for the maximum a posteriori (MAP) es...
research
02/23/2023

Fast Computation of Branching Process Transition Probabilities via ADMM

Branching processes are a class of continuous-time Markov chains (CTMCs)...
research
12/23/2020

NBIHT: An Efficient Algorithm for 1-bit Compressed Sensing with Optimal Error Decay Rate

The Binary Iterative Hard Thresholding (BIHT) algorithm is a popular rec...

Please sign up or login with your details

Forgot password? Click here to reset