Vision Transformers for Single Image Dehazing

04/08/2022
by   Yuda Song, et al.
9

Image dehazing is a representative low-level vision task that estimates latent haze-free images from hazy images. In recent years, convolutional neural network-based methods have dominated image dehazing. However, vision Transformers, which has recently made a breakthrough in high-level vision tasks, has not brought new dimensions to image dehazing. We start with the popular Swin Transformer and find that several of its key designs are unsuitable for image dehazing. To this end, we propose DehazeFormer, which consists of various improvements, such as the modified normalization layer, activation function, and spatial information aggregation scheme. We train multiple variants of DehazeFormer on various datasets to demonstrate its effectiveness. Specifically, on the most frequently used SOTS indoor set, our small model outperforms FFA-Net with only 25 To the best of our knowledge, our large model is the first method with the PSNR over 40 dB on the SOTS indoor set, dramatically outperforming the previous state-of-the-art methods. We also collect a large-scale realistic remote sensing dehazing dataset for evaluating the method's capability to remove highly non-homogeneous haze.

READ FULL TEXT

page 3

page 4

page 10

research
03/30/2023

Masked Autoencoders as Image Processors

Transformers have shown significant effectiveness for various vision tas...
research
09/02/2022

Transformers in Remote Sensing: A Survey

Deep learning-based algorithms have seen a massive popularity in differe...
research
02/16/2023

Efficient 3D Object Reconstruction using Visual Transformers

Reconstructing a 3D object from a 2D image is a well-researched vision p...
research
07/13/2021

HAT: Hierarchical Aggregation Transformers for Person Re-identification

Recently, with the advance of deep Convolutional Neural Networks (CNNs),...
research
08/07/2023

Improving FHB Screening in Wheat Breeding Using an Efficient Transformer Model

Fusarium head blight is a devastating disease that causes significant ec...
research
09/15/2022

Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer?

Vision Transformers (ViTs) have proven to be effective, in solving 2D im...
research
06/21/2023

EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representations

Equivariant Transformers such as Equiformer have demonstrated the effica...

Please sign up or login with your details

Forgot password? Click here to reset