DeepAI AI Chat
Log In Sign Up

Remote sensing image fusion based on Bayesian GAN

by   Junfu Chen, et al.

Remote sensing image fusion technology (pan-sharpening) is an important means to improve the information capacity of remote sensing images. Inspired by the efficient arameter space posteriori sampling of Bayesian neural networks, in this paper we propose a Bayesian Generative Adversarial Network based on Preconditioned Stochastic Gradient Langevin Dynamics (PGSLD-BGAN) to improve pan-sharpening tasks. Unlike many traditional generative models that consider only one optimal solution (might be locally optimal), the proposed PGSLD-BGAN performs Bayesian inference on the network parameters, and explore the generator posteriori distribution, which assists selecting the appropriate generator parameters. First, we build a two-stream generator network with PAN and MS images as input, which consists of three parts: feature extraction, feature fusion and image reconstruction. Then, we leverage Markov discriminator to enhance the ability of generator to reconstruct the fusion image, so that the result image can retain more details. Finally, introducing Preconditioned Stochastic Gradient Langevin Dynamics policy, we perform Bayesian inference on the generator network. Experiments on QuickBird and WorldView datasets show that the model proposed in this paper can effectively fuse PAN and MS images, and be competitive with even superior to state of the arts in terms of subjective and objective metrics.


page 12

page 13


PSGAN: A Generative Adversarial Network for Remote Sensing Image Pan-Sharpening

Remote sensing image fusion (also known as pan-sharpening) aims to gener...

PC-GANs: Progressive Compensation Generative Adversarial Networks for Pan-sharpening

The fusion of multispectral and panchromatic images is always dubbed pan...

Multi-Attention Generative Adversarial Network for Remote Sensing Image Super-Resolution

Image super-resolution (SR) methods can generate remote sensing images w...

FGF-GAN: A Lightweight Generative Adversarial Network for Pansharpening via Fast Guided Filter

Pansharpening is a widely used image enhancement technique for remote se...

Efficient and Accurate Hyperspectral Pansharpening Using 3D VolumeNet and 2.5D Texture Transfer

Recently, convolutional neural networks (CNN) have obtained promising re...

Deep dual stream residual network with contextual attention for pansharpening of remote sensing images

Pansharpening enhances spatial details of high spectral resolution multi...

MRF-Based Multispectral Image Fusion Using an Adaptive Approach Based on Edge-Guided Interpolation

In interpretation of remote sensing images, it is possible that some ima...