Manifold-Inspired Single Image Interpolation

07/31/2021
by   Lantao Yu, et al.
0

Manifold models consider natural-image patches to be on a low-dimensional manifold embedded in a high dimensional state space and each patch and its similar patches to approximately lie on a linear affine subspace. Manifold models are closely related to semi-local similarity, a well-known property of natural images, referring to that for most natural-image patches, several similar patches can be found in its spatial neighborhood. Many approaches to single image interpolation use manifold models to exploit semi-local similarity by two mutually exclusive parts: i) searching each target patch's similar patches and ii) operating on the searched similar patches, the target patch and the measured input pixels to estimate the target patch. Unfortunately, aliasing in the input image makes it challenging for both parts. A very few works explicitly deal with those challenges and only ad-hoc solutions are proposed. To overcome the challenge in the first part, we propose a carefully-designed adaptive technique to remove aliasing in severely aliased regions, which cannot be removed from traditional techniques. This technique enables reliable identification of similar patches even in the presence of strong aliasing. To overcome the challenge in the second part, we propose to use the aliasing-removed image to guide the initialization of the interpolated image and develop a progressive scheme to refine the interpolated image based on manifold models. Experimental results demonstrate that our approach reconstructs edges with both smoothness along contours and sharpness across profiles, and achieves an average Peak Signal-to-Noise Ratio (PSNR) significantly higher than existing model-based approaches.

READ FULL TEXT

page 1

page 2

page 8

page 9

page 11

page 12

page 13

research
01/18/2019

Good Similar Patches for Image Denoising

Patch-based denoising algorithms like BM3D have achieved outstanding per...
research
10/08/2020

Single-Image Camera Response Function Using Prediction Consistency and Gradual Refinement

A few methods have been proposed to estimate the CRF from a single image...
research
12/01/2018

Internal Distribution Matching for Natural Image Retargeting

Good Visual Retargeting changes the global size and aspect ratio of a na...
research
04/16/2019

Patch alignment manifold matting

Image matting is generally modeled as a space transform from the color s...
research
06/27/2022

Patch Selection for Melanoma Classification

In medical image processing, the most important information is often loc...
research
05/17/2019

Neither Global Nor Local: A Hierarchical Robust Subspace Clustering For Image Data

In this paper, we consider the problem of subspace clustering in presenc...
research
04/12/2019

Patch redundancy in images: a statistical testing framework and some applications

In this work we introduce a statistical framework in order to analyze th...

Please sign up or login with your details

Forgot password? Click here to reset