Accelerating Plug-and-Play Image Reconstruction via Multi-Stage Sketched Gradients

03/14/2022
by   Junqi Tang, et al.
0

In this work we propose a new paradigm for designing fast plug-and-play (PnP) algorithms using dimensionality reduction techniques. Unlike existing approaches which utilize stochastic gradient iterations for acceleration, we propose novel multi-stage sketched gradient iterations which first perform downsampling dimensionality reduction in the image space, and then efficiently approximate the true gradient using the sketched gradient in the low-dimensional space. This sketched gradient scheme can also be naturally combined with PnP-SGD methods for further improvement on computational complexity. As a generic acceleration scheme, it can be applied to accelerate any existing PnP/RED algorithm. Our numerical experiments on X-ray fan-beam CT demonstrate the remarkable effectiveness of our scheme, that a computational free-lunch can be obtained using this dimensionality reduction in the image space.

READ FULL TEXT

page 4

page 5

page 6

research
08/31/2022

Accelerating Deep Unrolling Networks via Dimensionality Reduction

In this work we propose a new paradigm for designing efficient deep unro...
research
03/21/2022

Operator Sketching for Deep Unrolling Networks

In this work we propose a new paradigm for designing efficient deep unro...
research
06/20/2022

GiDR-DUN; Gradient Dimensionality Reduction – Differences and Unification

TSNE and UMAP are two of the most popular dimensionality reduction algor...
research
11/04/2021

ExClus: Explainable Clustering on Low-dimensional Data Representations

Dimensionality reduction and clustering techniques are frequently used t...
research
05/12/2023

ActUp: Analyzing and Consolidating tSNE and UMAP

tSNE and UMAP are popular dimensionality reduction algorithms due to the...
research
03/06/2021

Low-Rank Isomap Algorithm

The Isomap is a well-known nonlinear dimensionality reduction method tha...
research
03/18/2011

Optimal Dimensionality Reduction of Complex Dynamics: The Chess Game as Diffusion on a Free Energy Landscape

Dimensionality reduction is ubiquitous in analysis of complex dynamics. ...

Please sign up or login with your details

Forgot password? Click here to reset