Relaxed regularization for linear inverse problems
share
We consider regularized least-squares problems of the form min_x1/2‖ Ax - b‖_2^2 + ℛ(Lx). Recently, Zheng et al., 2019, proposed an algorithm called Sparse Relaxed Regularized Regression (SR3) that employs a splitting strategy by introducing an auxiliary variable y and solves min_x,y1/2‖ Ax - b‖_2^2 + κ/2‖ Lx - y‖_2^2 + ℛ(x). By minimizing out the variable x we obtain an equivalent system min_y1/2‖ F_κy - g_κ‖_2^2+ℛ(y). In our work we view the SR3 method as a way to approximately solve the regularized problem. We analyze the conditioning of the relaxed problem in general and give an expression for the SVD of F_κ as a function of κ. Furthermore, we relate the Pareto curve of the original problem to the relaxed problem and we quantify the error incurred by relaxation in terms of κ. Finally, we propose an efficient iterative method for solving the relaxed problem with inexact inner iterations. Numerical examples illustrate the approach.
READ FULL TEXT