Stochastic EM methods with Variance Reduction for Penalised PET Reconstructions

06/06/2021
by   Zeljko Kereta, et al.
0

Expectation-maximization (EM) is a popular and well-established method for image reconstruction in positron emission tomography (PET) but it often suffers from slow convergence. Ordered subset EM (OSEM) is an effective reconstruction algorithm that provides significant acceleration during initial iterations, but it has been observed to enter a limit cycle. In this work, we investigate two classes of algorithms for accelerating OSEM based on variance reduction for penalised PET reconstructions. The first is a stochastic variance reduced EM algorithm, termed as SVREM, an extension of the classical EM to the stochastic context, by combining classical OSEM with insights from variance reduction techniques for gradient descent. The second views OSEM as a preconditioned stochastic gradient ascent, and applies variance reduction techniques, i.e., SAGA and SVRG, to estimate the update direction. We present several numerical experiments to illustrate the efficiency and accuracy of the approaches. The numerical results show that these approaches significantly outperform existing OSEM type methods for penalised PET reconstructions, and hold great potential.

READ FULL TEXT

page 15

page 17

research
11/24/2020

Geom-SPIDER-EM: Faster Variance Reduced Stochastic Expectation Maximization for Nonconvex Finite-Sum Optimization

The Expectation Maximization (EM) algorithm is a key reference for infer...
research
03/18/2018

Damped Anderson acceleration with restarts and monotonicity control for accelerating EM and EM-like algorithms

The expectation-maximization (EM) algorithm is a well-known iterative me...
research
10/28/2019

On the Global Convergence of (Fast) Incremental Expectation Maximization Methods

The EM algorithm is one of the most popular algorithm for inference in l...
research
11/05/2022

Stochastic Variance Reduced Gradient for affine rank minimization problem

We develop an efficient stochastic variance reduced gradient descent alg...
research
02/13/2023

Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EM

The central problem in cryo-electron microscopy (cryo-EM) is to recover ...
research
01/23/2013

Accelerating EM: An Empirical Study

Many applications require that we learn the parameters of a model from d...
research
09/26/2018

Residuum-Condition Diagram and Reduction of Over-Complete Endmember-Sets

Extracting reference spectra, or endmembers (EMs) from a given multi- or...

Please sign up or login with your details

Forgot password? Click here to reset