AnimeSR: Learning Real-World Super-Resolution Models for Animation Videos

06/14/2022
by   Yanze Wu, et al.
0

This paper studies the problem of real-world video super-resolution (VSR) for animation videos, and reveals three key improvements for practical animation VSR. First, recent real-world super-resolution approaches typically rely on degradation simulation using basic operators without any learning capability, such as blur, noise, and compression. In this work, we propose to learn such basic operators from real low-quality animation videos, and incorporate the learned ones into the degradation generation pipeline. Such neural-network-based basic operators could help to better capture the distribution of real degradations. Second, a large-scale high-quality animation video dataset, AVC, is built to facilitate comprehensive training and evaluations for animation VSR. Third, we further investigate an efficient multi-scale network structure. It takes advantage of the efficiency of unidirectional recurrent networks and the effectiveness of sliding-window-based methods. Thanks to the above delicate designs, our method, AnimeSR, is capable of restoring real-world low-quality animation videos effectively and efficiently, achieving superior performance to previous state-of-the-art methods.

READ FULL TEXT

page 5

page 13

page 14

page 15

page 18

page 21

page 23

page 24

research
05/24/2023

NegVSR: Augmenting Negatives for Generalized Noise Modeling in Real-World Video Super-Resolution

The capability of video super-resolution (VSR) to synthesize high-resolu...
research
08/02/2020

Video Super-Resolution with Recurrent Structure-Detail Network

Most video super-resolution methods super-resolve a single reference fra...
research
03/28/2022

Reference-based Video Super-Resolution Using Multi-Camera Video Triplets

We propose the first reference-based video super-resolution (RefVSR) app...
research
07/02/2019

A Single Video Super-Resolution GAN for Multiple Downsampling Operators based on Pseudo-Inverse Image Formation Models

The popularity of high and ultra-high definition displays has led to the...
research
05/24/2023

EgoVSR: Towards High-Quality Egocentric Video Super-Resolution

Due to the limitations of capture devices and scenarios, egocentric vide...
research
11/24/2021

Investigating Tradeoffs in Real-World Video Super-Resolution

The diversity and complexity of degradations in real-world video super-r...
research
04/13/2020

Multi-modal Datasets for Super-resolution

Nowdays, most datasets used to train and evaluate super-resolution model...

Please sign up or login with your details

Forgot password? Click here to reset