Let Segment Anything Help Image Dehaze

06/28/2023
by   Zheyan Jin, et al.
0

The large language model and high-level vision model have achieved impressive performance improvements with large datasets and model sizes. However, low-level computer vision tasks, such as image dehaze and blur removal, still rely on a small number of datasets and small-sized models, which generally leads to overfitting and local optima. Therefore, we propose a framework to integrate large-model prior into low-level computer vision tasks. Just as with the task of image segmentation, the degradation of haze is also texture-related. So we propose to detect gray-scale coding, network channel expansion, and pre-dehaze structures to integrate large-model prior knowledge into any low-level dehazing network. We demonstrate the effectiveness and applicability of large models in guiding low-level visual tasks through different datasets and algorithms comparison experiments. Finally, we demonstrate the effect of grayscale coding, network channel expansion, and recurrent network structures through ablation experiments. Under the conditions where additional data and training resources are not required, we successfully prove that the integration of large-model prior knowledge will improve the dehaze performance and save training time for low-level visual tasks.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 8

page 10

research
04/20/2020

LSM: Learning Subspace Minimization for Low-level Vision

We study the energy minimization problem in low-level vision tasks from ...
research
03/06/2013

On Considering Uncertainty and Alternatives in Low-Level Vision

In this paper we address the uncertainty issues involved in the low-leve...
research
12/17/2019

Feature Fusion Use Unsupervised Prior Knowledge to Let Small Object Represent

Fusing low level and high level features is a widely used strategy to pr...
research
11/22/2022

Rethinking Implicit Neural Representations for Vision Learners

Implicit Neural Representations (INRs) are powerful to parameterize cont...
research
02/14/2023

Take a Prior from Other Tasks for Severe Blur Removal

Recovering clear structures from severely blurry inputs is a challenging...
research
02/26/2020

Automatically Searching for U-Net Image Translator Architecture

Image translators have been successfully applied to many important low l...
research
05/14/2018

Learning Dual Convolutional Neural Networks for Low-Level Vision

In this paper, we propose a general dual convolutional neural network (D...

Please sign up or login with your details

Forgot password? Click here to reset