Self-Supervised training for blind multi-frame video denoising

04/15/2020
by   Dewil Valéry, et al.
0

We propose a self-supervised approach for training multi-frame video denoising networks. These networks predict frame t from a window of frames around t. Our self-supervised approach benefits from the video temporal consistency by penalizing a loss between the predicted frame t and a neighboring target frame, which are aligned using an optical flow. We use the proposed strategy for online internal learning, where a pre-trained network is fine-tuned to denoise a new unknown noise type from a single video. After a few frames, the proposed fine-tuning reaches and sometimes surpasses the performance of a state-of-the-art network trained with supervision. In addition, for a wide range of noise types, it can be applied blindly without knowing the noise distribution. We demonstrate this by showing results on blind denoising of different synthetic and realistic noises.

READ FULL TEXT

page 2

page 8

page 12

page 13

page 14

research
11/30/2018

Model-blind Video Denoising Via Frame-to-frame Training

Modeling the processing chain that has produced a video is a difficult r...
research
07/07/2020

Learning Model-Blind Temporal Denoisers without Ground Truths

Denoisers trained with synthetic data often fail to cope with the divers...
research
03/09/2020

Restore from Restored: Video Restoration with Pseudo Clean Video

In this paper, we propose a self-supervised video denoising method calle...
research
09/16/2023

FrameRS: A Video Frame Compression Model Composed by Self supervised Video Frame Reconstructor and Key Frame Selector

In this paper, we present frame reconstruction model: FrameRS. It consis...
research
08/07/2023

Recurrent Self-Supervised Video Denoising with Denser Receptive Field

Self-supervised video denoising has seen decent progress through the use...
research
04/24/2019

ViDeNN: Deep Blind Video Denoising

We propose ViDeNN: a CNN for Video Denoising without prior knowledge on ...
research
10/20/2022

SS-VAERR: Self-Supervised Apparent Emotional Reaction Recognition from Video

This work focuses on the apparent emotional reaction recognition (AERR) ...

Please sign up or login with your details

Forgot password? Click here to reset