PACO: Signal Restoration via PAtch COnsensus

Many signal processing algorithms operate by breaking the target signal into possibly overlapping segments (typically called windows or patches), processing them separately, and then stitching them back into place to produce a unified output. In most cases where pach overlapping occurs, the final value of those samples that are estimated by more than one patch is resolved by averaging those estimates; this includes many recent image processing algorithms. In other cases, typically frequency-based restoration methods, the average is implicitly weighted by some window function such as Hanning, Blackman, etc. which is applied prior to the Fourier/DCT transform in order to avoid Gibbs oscillations in the processed patches. Such averaging may incidentally help in covering up artifacts in the restoration process, but more often will simply degrade the overall result, posing an upper limit to the size of the patches that can be used. In order to avoid such drawbacks, we propose a new methodology where the different estimates of any given sample are forced to be identical. We show that, together, these consensus constraints constitute a non-empty convex feasible set, provide a general formulation of the resulting constrained optimization problem which can be applied to a wide variety of signal restoration tasks, and propose an efficient algorithm for finding the corresponding solutions. Finally, we describe in detail the application of the proposed methodology to three different signal processing problems, in some cases surpassing the state of the art by a significant margin.

READ FULL TEXT

page 1

page 7

page 9

page 10

research
10/17/2019

Introducing Hann windows for reducing edge-effects in patch-based image segmentation

There is a limitation in the size of an image that can be processed usin...
research
06/16/2020

Structured and Localized Image Restoration

We present a novel approach to image restoration that leverages ideas fr...
research
04/20/2021

Posterior Sampling for Image Restoration using Explicit Patch Priors

Almost all existing methods for image restoration are based on optimizin...
research
09/04/2023

Restoration Guarantee of Image Inpainting via Low Rank Patch Matrix Completion

In recent years, patch-based image restoration approaches have demonstra...
research
02/26/2016

Patch-Ordering as a Regularization for Inverse Problems in Image Processing

Recent work in image processing suggests that operating on (overlapping)...
research
06/16/2016

CLEAR: Covariant LEAst-square Re-fitting with applications to image restoration

In this paper, we propose a new framework to remove parts of the systema...
research
02/20/2018

Non-Local Graph-Based Prediction For Reversible Data Hiding In Images

Reversible data hiding (RDH) is desirable in applications where both the...

Please sign up or login with your details

Forgot password? Click here to reset