PromptIR: Prompting for All-in-One Blind Image Restoration

06/22/2023
by   Vaishnav Potlapalli, et al.
0

Image restoration involves recovering a high-quality clean image from its degraded version. Deep learning-based methods have significantly improved image restoration performance, however, they have limited generalization ability to different degradation types and levels. This restricts their real-world application since it requires training individual models for each specific degradation and knowing the input degradation type to apply the relevant model. We present a prompt-based learning approach, PromptIR, for All-In-One image restoration that can effectively restore images from various types and levels of degradation. In particular, our method uses prompts to encode degradation-specific information, which is then used to dynamically guide the restoration network. This allows our method to generalize to different degradation types and levels, while still achieving state-of-the-art results on image denoising, deraining, and dehazing. Overall, PromptIR offers a generic and efficient plugin module with few lightweight prompts that can be used to restore images of various types and levels of degradation with no prior information on the corruptions present in the image. Our code and pretrained models are available here: https://github.com/va1shn9v/PromptIR

READ FULL TEXT

page 2

page 6

page 7

page 16

page 17

page 18

research
12/23/2018

Estimation and Restoration of Compositional Degradation Using Convolutional Neural Networks

Image restoration from a single image degradation type, such as blurring...
research
05/20/2018

Dynamically Unfolding Recurrent Restorer: A Moving Endpoint Control Method for Image Restoration

In this paper, we propose a new control framework called the moving endp...
research
06/13/2022

One Size Fits All: Hypernetwork for Tunable Image Restoration

We introduce a novel approach for tunable image restoration that achieve...
research
06/08/2023

HQ-50K: A Large-scale, High-quality Dataset for Image Restoration

This paper introduces a new large-scale image restoration dataset, calle...
research
03/13/2023

DR2: Diffusion-based Robust Degradation Remover for Blind Face Restoration

Blind face restoration usually synthesizes degraded low-quality data wit...
research
06/23/2023

ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restoration

Image restoration aims to reconstruct degraded images, e.g., denoising o...
research
07/16/2022

RCRN: Real-world Character Image Restoration Network via Skeleton Extraction

Constructing high-quality character image datasets is challenging becaus...

Please sign up or login with your details

Forgot password? Click here to reset