SAR-to-EO Image Translation with Multi-Conditional Adversarial Networks

07/26/2022
by   Armando Cabrera, et al.
0

This paper explores the use of multi-conditional adversarial networks for SAR-to-EO image translation. Previous methods condition adversarial networks only on the input SAR. We show that incorporating multiple complementary modalities such as Google maps and IR can further improve SAR-to-EO image translation especially on preserving sharp edges of manmade objects. We demonstrate effectiveness of our approach on a diverse set of datasets including SEN12MS, DFC2020, and SpaceNet6. Our experimental results suggest that additional information provided by complementary modalities improves the performance of SAR-to-EO image translation compared to the models trained on paired SAR and EO data only. To best of our knowledge, our approach is the first to leverage multiple modalities for improving SAR-to-EO image translation performance.

READ FULL TEXT

page 2

page 3

page 4

page 5

research
07/20/2018

Dialectical GAN for SAR Image Translation: From Sentinel-1 to TerraSAR-X

Contrary to optical images, Synthetic Aperture Radar (SAR) images are in...
research
01/24/2019

Reciprocal Translation between SAR and Optical Remote Sensing Images with Cascaded-Residual Adversarial Networks

Despite the advantages of all-weather and all-day high-resolution imagin...
research
07/14/2023

Improved Flood Insights: Diffusion-Based SAR to EO Image Translation

Driven by rapid climate change, the frequency and intensity of flood eve...
research
08/03/2020

Generative Adversarial Networks for Synthesizing InSAR Patches

Generative Adversarial Networks (GANs) have been employed with certain s...
research
06/22/2023

1st Place Solution to MultiEarth 2023 Challenge on Multimodal SAR-to-EO Image Translation

The Multimodal Learning for Earth and Environment Workshop (MultiEarth 2...
research
05/23/2023

SAR-to-Optical Image Translation via Thermodynamics-inspired Network

Synthetic aperture radar (SAR) is prevalent in the remote sensing field ...
research
10/01/2016

Radial Velocity Retrieval for Multichannel SAR Moving Targets with Time-Space Doppler De-ambiguity

In this paper, with respect to multichannel synthetic aperture radars (S...

Please sign up or login with your details

Forgot password? Click here to reset