Patch Craft: Video Denoising by Deep Modeling and Patch Matching

03/25/2021
by   Gregory Vaksman, et al.
0

The non-local self-similarity property of natural images has been exploited extensively for solving various image processing problems. When it comes to video sequences, harnessing this force is even more beneficial due to the temporal redundancy. In the context of image and video denoising, many classically-oriented algorithms employ self-similarity, splitting the data into overlapping patches, gathering groups of similar ones and processing these together somehow. With the emergence of convolutional neural networks (CNN), the patch-based framework has been abandoned. Most CNN denoisers operate on the whole image, leveraging non-local relations only implicitly by using a large receptive field. This work proposes a novel approach for leveraging self-similarity in the context of video denoising, while still relying on a regular convolutional architecture. We introduce a concept of patch-craft frames - artificial frames that are similar to the real ones, built by tiling matched patches. Our algorithm augments video sequences with patch-craft frames and feeds them to a CNN. We demonstrate the substantial boost in denoising performance obtained with the proposed approach.

READ FULL TEXT

page 4

page 7

page 8

page 13

page 14

page 15

research
11/30/2018

Non-Local Video Denoising by CNN

Non-local patch based methods were until recently state-of-the-art for i...
research
04/12/2019

Patch redundancy in images: a statistical testing framework and some applications

In this work we introduce a statistical framework in order to analyze th...
research
11/17/2019

Low-Weight and Learnable Image Denoising

Image denoising is a well studied problem with an extensive activity tha...
research
03/22/2016

Con-Patch: When a Patch Meets its Context

Measuring the similarity between patches in images is a fundamental buil...
research
11/12/2019

MRI denoising using Deep Learning and Non-local averaging

This paper proposes a novel method for automatic MRI denoising that expl...
research
12/05/2019

Revisiting Non Local Sparse Models for Image Restoration

We propose a differentiable algorithm for image restoration inspired by ...
research
09/09/2021

EEGDnet: Fusing Non-Local and Local Self-Similarity for 1-D EEG Signal Denoising with 2-D Transformer

Electroencephalogram (EEG) has shown a useful approach to produce a brai...

Please sign up or login with your details

Forgot password? Click here to reset