S3Net: A Single Stream Structure for Depth Guided Image Relighting

05/03/2021
by   Hao-Hsiang Yang, et al.
2

Depth guided any-to-any image relighting aims to generate a relit image from the original image and corresponding depth maps to match the illumination setting of the given guided image and its depth map. To the best of our knowledge, this task is a new challenge that has not been addressed in the previous literature. To address this issue, we propose a deep learning-based neural Single Stream Structure network called S3Net for depth guided image relighting. This network is an encoder-decoder model. We concatenate all images and corresponding depth maps as the input and feed them into the model. The decoder part contains the attention module and the enhanced module to focus on the relighting-related regions in the guided images. Experiments performed on challenging benchmark show that the proposed model achieves the 3 rd highest SSIM in the NTIRE 2021 Depth Guided Any-to-any Relighting Challenge.

READ FULL TEXT

page 2

page 4

page 6

page 7

research
05/03/2021

Multi-modal Bifurcated Network for Depth Guided Image Relighting

Image relighting aims to recalibrate the illumination setting in an imag...
research
12/07/2022

Encoder-Decoder Network with Guided Transmission Map: Architecture – Extended Abstract

An insight into the architecture of the Encoder-Decoder Network with Gui...
research
02/07/2022

Confidence Guided Depth Completion Network

The paper proposes an image-guided depth completion method to estimate a...
research
07/01/2020

M3d-CAM: A PyTorch library to generate 3D data attention maps for medical deep learning

M3d-CAM is an easy to use library for generating attention maps of CNN-b...
research
03/13/2023

SelfPromer: Self-Prompt Dehazing Transformers with Depth-Consistency

This work presents an effective depth-consistency self-prompt Transforme...
research
03/28/2017

Robust Guided Image Filtering

The process of using one image to guide the filtering process of another...
research
09/15/2023

STDG: Semi-Teacher-Student Training Paradigram for Depth-guided One-stage Scene Graph Generation

Scene Graph Generation is a critical enabler of environmental comprehens...

Please sign up or login with your details

Forgot password? Click here to reset