RIS-GAN: Explore Residual and Illumination with Generative Adversarial Networks for Shadow Removal

11/20/2019
by   Ling Zhang, et al.
46

Residual images and illumination estimation have been proved very helpful in image enhancement. In this paper, we propose a general and novel framework RIS-GAN which explores residual and illumination with Generative Adversarial Networks for shadow removal. Combined with the coarse shadow-removal image, the estimated negative residual images and inverse illumination maps can be used to generate indirect shadow-removal images to refine the coarse shadow-removal result to the fine shadow-free image in a coarse-to-fine fashion. Three discriminators are designed to distinguish whether the predicted negative residual images, shadow-removal images, and the inverse illumination maps are real or fake jointly compared with the corresponding ground-truth information. To our best knowledge, we are the first one to explore residual and illumination for shadow removal. We evaluate our proposed method on two benchmark datasets, i.e., SRD and ISTD, and the extensive experiments demonstrate that our proposed method achieves the superior performance to state-of-the-arts, although we have no particular shadow-aware components designed in our generators.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
01/22/2018

Staff line Removal using Generative Adversarial Networks

Staff line removal is a crucial pre-processing step in Optical Music Rec...
research
10/22/2021

Generative Adversarial Networks for Non-Raytraced Global Illumination on Older GPU Hardware

We give an overview of the different rendering methods and we demonstrat...
research
10/03/2020

Unsupervised Shadow Removal Using Target Consistency Generative Adversarial Network

Unsupervised shadow removal aims to learn a non-linear function to map t...
research
09/13/2023

ShaDocFormer: A Shadow-attentive Threshold Detector with Cascaded Fusion Refiner for document shadow removal

Document shadow is a common issue that arise when capturing documents us...
research
10/09/2020

Deep-Masking Generative Network: A Unified Framework for Background Restoration from Superimposed Images

Restoring the clean background from the superimposed images containing a...
research
09/22/2020

A Generative Adversarial Approach with Residual Learning for Dust and Scratches Artifacts Removal

Retouching can significantly elevate the visual appeal of photos, but ma...
research
08/02/2016

Interactive Removal and Ground Truth for Difficult Shadow Scenes

A user-centric method for fast, interactive, robust and high-quality sha...

Please sign up or login with your details

Forgot password? Click here to reset