Multi-Field De-interlacing using Deformable Convolution Residual Blocks and Self-Attention

09/21/2022
by   Ronglei Ji, et al.
0

Although deep learning has made significant impact on image/video restoration and super-resolution, learned deinterlacing has so far received less attention in academia or industry. This is despite deinterlacing is well-suited for supervised learning from synthetic data since the degradation model is known and fixed. In this paper, we propose a novel multi-field full frame-rate deinterlacing network, which adapts the state-of-the-art superresolution approaches to the deinterlacing task. Our model aligns features from adjacent fields to a reference field (to be deinterlaced) using both deformable convolution residual blocks and self attention. Our extensive experimental results demonstrate that the proposed method provides state-of-the-art deinterlacing results in terms of both numerical and perceptual performance. At the time of writing, our model ranks first in the Full FrameRate LeaderBoard at https://videoprocessing.ai/benchmarks/deinterlacer.html

READ FULL TEXT

page 2

page 4

research
10/01/2020

Deformable Kernel Convolutional Network for Video Extreme Super-Resolution

Video super-resolution, which attempts to reconstruct high-resolution vi...
research
08/26/2021

Self-Attention for Audio Super-Resolution

Convolutions operate only locally, thus failing to model global interact...
research
03/01/2023

Efficient and Explicit Modelling of Image Hierarchies for Image Restoration

The aim of this paper is to propose a mechanism to efficiently and expli...
research
10/20/2022

Single Image Super-Resolution Using Lightweight Networks Based on Swin Transformer

Image super-resolution reconstruction is an important task in the field ...
research
02/28/2023

Swin Deformable Attention Hybrid U-Net for Medical Image Segmentation

How to harmonize convolution and multi-head self-attention mechanisms ha...
research
03/07/2020

Super Resolution Using Segmentation-Prior Self-Attention Generative Adversarial Network

Convolutional Neural Network (CNN) is intensively implemented to solve s...
research
03/06/2022

CNN self-attention voice activity detector

In this work we present a novel single-channel Voice Activity Detector (...

Please sign up or login with your details

Forgot password? Click here to reset