W2S: A Joint Denoising and Super-Resolution Dataset

by   Ruofan Zhou, et al.

Denoising and super-resolution (SR) are fundamental tasks in imaging. These two restoration tasks are well covered in the literature, however, only separately. Given a noisy low-resolution (LR) input image, it is yet unclear what the best approach would be in order to obtain a noise-free high-resolution (HR) image. In order to study joint denoising and super-resolution (JDSR), a dataset containing pairs of noisy LR images and the corresponding HR images is fundamental. We propose such a novel JDSR dataset, Wieldfield2SIM (W2S), acquired using microscopy equipment and techniques. W2S is comprised of 144,000 real fluorescence microscopy images, used to form a total of 360 sets of images. A set is comprised of noisy LR images with different noise levels, a noise-free LR image, and a corresponding high-quality HR image. W2S allows us to benchmark the combinations of 6 denoising methods and 6 SR methods. We show that state-of-the-art SR networks perform very poorly on noisy inputs, with a loss reaching 14dB relative to noise-free inputs. Our evaluation also shows that applying the best denoiser in terms of reconstruction error followed by the best SR method does not yield the best result. The best denoising PSNR can, for instance, come at the expense of a loss in high frequencies, which is detrimental for SR methods. We lastly demonstrate that a light-weight SR network with a novel texture loss, trained specifically for JDSR, outperforms any combination of state-of-the-art deep denoising and SR networks.


page 2

page 6

page 12

page 14


Image Denoising and Super-Resolution using Residual Learning of Deep Convolutional Network

Image super-resolution and denoising are two important tasks in image pr...

DISGAN: Wavelet-informed Discriminator Guides GAN to MRI Super-resolution with Noise Cleaning

MRI super-resolution (SR) and denoising tasks are fundamental challenges...

Deep Parametric 3D Filters for Joint Video Denoising and Illumination Enhancement in Video Super Resolution

Despite the quality improvement brought by the recent methods, video sup...

Microscopy Image Restoration using Deep Learning on W2S

We leverage deep learning techniques to jointly denoise and super-resolv...

Boosting High-Level Vision with Joint Compression Artifacts Reduction and Super-Resolution

Due to the limits of bandwidth and storage space, digital images are usu...

Cryo-ZSSR: multiple-image super-resolution based on deep internal learning

Single-particle cryo-electron microscopy (cryo-EM) is an emerging imagin...

Decimated Prony's Method for Stable Super-resolution

We study recovery of amplitudes and nodes of a finite impulse train from...

Please sign up or login with your details

Forgot password? Click here to reset