CFSNet: Toward a Controllable Feature Space for Image Restoration

04/01/2019
by   Wei Wang, et al.
0

Deep learning methods have witnessed the great progress in image restoration with specific metrics (e.g., PSNR, SSIM). However, the perceptual quality of the restored image is relatively subjective, and it is necessary for users to control the reconstruction result according to personal preferences or image characteristics, which cannot be done using existing deterministic networks. This motivates us to exquisitely design a unified interactive framework for general image restoration tasks. Under this framework, users can control continuous transition of different objectives, e.g., the perception-distortion trade-off of image super-resolution, the trade-off between noise reduction and detail preservation. We achieve this goal by controlling latent features of the designed network. To be specific, our proposed framework, named Controllable Feature Space Network (CFSNet), is entangled by two branches based on different objectives. Our model can adaptively learn the coupling coefficients of different layers and channels, which provides finer control of the restored image quality. Experiments on several typical image restoration tasks fully validate the effective benefits of the proposed method.

READ FULL TEXT

page 1

page 7

page 8

research
05/22/2023

Restore Anything Pipeline: Segment Anything Meets Image Restoration

Recent image restoration methods have produced significant advancements ...
research
11/01/2018

Analyzing Perception-Distortion Tradeoff using Enhanced Perceptual Super-resolution Network

Convolutional neural network (CNN) based methods have recently achieved ...
research
02/28/2023

TextIR: A Simple Framework for Text-based Editable Image Restoration

Most existing image restoration methods use neural networks to learn str...
research
05/07/2021

Toward Interactive Modulation for Photo-Realistic Image Restoration

Modulating image restoration level aims to generate a restored image by ...
research
12/11/2019

Multi-Dimension Modulation for Image Restoration with Dynamic Controllable Residual Learning

Based on the great success of deterministic learning, to interactively c...
research
10/24/2019

Interactive Image Restoration

Machine learning and many of its applications are considered hard to app...
research
11/16/2022

Reasons for the Superiority of Stochastic Estimators over Deterministic Ones: Robustness, Consistency and Perceptual Quality

Stochastic restoration algorithms allow to explore the space of solution...

Please sign up or login with your details

Forgot password? Click here to reset