Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting

06/25/2020
by   Wenqing Ouyang, et al.
0

The alternating direction multiplier method (ADMM) is widely used in computer graphics for solving optimization problems that can be nonsmooth and nonconvex. It converges quickly to an approximate solution, but can take a long time to converge to a solution of high-accuracy. Previously, Anderson acceleration has been applied to ADMM, by treating it as a fixed-point iteration for the concatenation of the dual variables and a subset of the primal variables. In this paper, we note that the equivalence between ADMM and Douglas-Rachford splitting reveals that ADMM is in fact a fixed-point iteration in a lower-dimensional space. By applying Anderson acceleration to such lower-dimensional fixed-point iteration, we obtain a more effective approach for accelerating ADMM. We analyze the convergence of the proposed acceleration method on nonconvex problems, and verify its effectiveness on a variety of computer graphics problems including geometry processing and physical simulation.

READ FULL TEXT

page 9

page 10

page 11

research
09/01/2019

Accelerating ADMM for Efficient Simulation and Optimization

The alternating direction method of multipliers (ADMM) is a popular appr...
research
06/28/2019

Accelerated Symmetric ADMM and Its Applications in Signal Processing

The alternating direction method of multipliers (ADMM) were extensively ...
research
07/06/2020

Quantifying the asymptotic linear convergence speed of Anderson Acceleration applied to ADMM

We explain how Anderson Acceleration (AA) speeds up the Alternating Dire...
research
05/15/2018

Anderson Acceleration for Geometry Optimization and Physics Simulation

Many computer graphics problems require computing geometric shapes subje...
research
04/08/2019

Least-squares registration of point sets over SE (d) using closed-form projections

Consider the problem of registering multiple point sets in some d-dimens...
research
06/07/2017

A New Use of Douglas-Rachford Splitting and ADMM for Identifying Infeasible, Unbounded, and Pathological Conic Programs

In this paper, we present a method for identifying infeasible, unbounded...
research
02/28/2023

Modular and Parallelizable Multibody Physics Simulation via Subsystem-Based ADMM

In this paper, we present a new multibody physics simulation framework t...

Please sign up or login with your details

Forgot password? Click here to reset