Multi-frame image super-resolution with fast upscaling technique

by   Longguang Wang, et al.

Multi-frame image super-resolution (MISR) aims to fuse information in low-resolution (LR) image sequence to compose a high-resolution (HR) one, which is applied extensively in many areas recently. Different with single image super-resolution (SISR), sub-pixel transitions between multiple frames introduce additional information, attaching more significance to fusion operator to alleviate the ill-posedness of MISR. For reconstruction-based approaches, the inevitable projection of reconstruction errors from LR space to HR space is commonly tackled by an interpolation operator, however crude interpolation may not fit the natural image and generate annoying blurring artifacts, especially after fusion operator. In this paper, we propose an end-to-end fast upscaling technique to replace the interpolation operator, design upscaling filters in LR space for periodic sub-locations respectively and shuffle the filter results to derive the final reconstruction errors in HR space. The proposed fast upscaling technique not only reduce the computational complexity of the upscaling operation by utilizing shuffling operation to avoid complex operation in HR space, but also realize superior performance with fewer blurring artifacts. Extensive experimental results demonstrate the effectiveness and efficiency of the proposed technique, whilst, combining the proposed technique with bilateral total variation (BTV) regu-larization, the MISR approach outperforms state-of-the-art methods.



There are no comments yet.


page 2

page 6

page 7

page 8

page 9

page 10


Fast single image super-resolution based on sigmoid transformation

Single image super-resolution aims to generate a high-resolution image f...

Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network

Recently, several models based on deep neural networks have achieved gre...

DRFN: Deep Recurrent Fusion Network for Single-Image Super-Resolution with Large Factors

Recently, single-image super-resolution has made great progress owing to...

A Novel Fast 3D Single Image Super-Resolution Algorithm

This paper introduces a novel computationally efficient method of solvin...

A polygon-based interpolation operator for super-resolution imaging

We outline the super-resolution reconstruction problem posed as a maximi...

Image Reconstruction with Predictive Filter Flow

We propose a simple, interpretable framework for solving a wide range of...

Across-scale Process Similarity based Interpolation for Image Super-Resolution

A pivotal step in image super-resolution techniques is interpolation, wh...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.