Image quality measurements and denoising using Fourier Ring Correlations

01/11/2022
by   J. Kaczmar-Michalska, et al.
8

Image quality is a nebulous concept with different meanings to different people. To quantify image quality a relative difference is typically calculated between a corrupted image and a ground truth image. But what metric should we use for measuring this difference? Ideally, the metric should perform well for both natural and scientific images. The structural similarity index (SSIM) is a good measure for how humans perceive image similarities, but is not sensitive to differences that are scientifically meaningful in microscopy. In electron and super-resolution microscopy, the Fourier Ring Correlation (FRC) is often used, but is little known outside of these fields. Here we show that the FRC can equally well be applied to natural images, e.g. the Google Open Images dataset. We then define a loss function based on the FRC, show that it is analytically differentiable, and use it to train a U-net for denoising of images. This FRC-based loss function allows the network to train faster and achieve similar or better results than when using L1- or L2- based losses. We also investigate the properties and limitations of neural network denoising with the FRC analysis.

READ FULL TEXT

page 2

page 5

page 13

page 14

page 15

research
03/26/2021

Training a Better Loss Function for Image Restoration

Central to the application of neural networks in image restoration probl...
research
12/07/2017

Learned Perceptual Image Enhancement

Learning a typical image enhancement pipeline involves minimization of a...
research
06/26/2020

A Loss Function for Generative Neural Networks Based on Watson's Perceptual Model

To train Variational Autoencoders (VAEs) to generate realistic imagery r...
research
03/10/2023

A New Super-Resolution Measurement of Perceptual Quality and Fidelity

Super-resolution results are usually measured by full-reference image qu...
research
06/24/2020

Understanding SSIM

The use of the structural similarity index (SSIM) is widespread. For alm...
research
10/24/2020

Deep Denoising For Scientific Discovery: A Case Study In Electron Microscopy

Denoising is a fundamental challenge in scientific imaging. Deep convolu...
research
06/27/2022

DeStripe: A Self2Self Spatio-Spectral Graph Neural Network with Unfolded Hessian for Stripe Artifact Removal in Light-sheet Microscopy

Light-sheet fluorescence microscopy (LSFM) is a cutting-edge volumetric ...

Please sign up or login with your details

Forgot password? Click here to reset