Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry

04/20/2021
by   Dawa Derksen, et al.
0

We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation learning. For each scene, we train S-NeRF using very high spatial resolution optical images taken from known viewing angles. The learning requires no labels or shape priors: it is self-supervised by an image reconstruction loss. To accommodate for changing light source conditions both from a directional light source (the Sun) and a diffuse light source (the sky), we extend the NeRF approach in two ways. First, direct illumination from the Sun is modeled via a local light source visibility field. Second, indirect illumination from a diffuse light source is learned as a non-local color field as a function of the position of the Sun. Quantitatively, the combination of these factors reduces the altitude and color errors in shaded areas, compared to NeRF. The S-NeRF methodology not only performs novel view synthesis and full 3D shape estimation, it also enables shadow detection, albedo synthesis, and transient object filtering, without any explicit shape supervision.

READ FULL TEXT

page 2

page 7

page 8

research
03/10/2023

Aleth-NeRF: Low-light Condition View Synthesis with Concealing Fields

Common capture low-light scenes are challenging for most computer vision...
research
05/10/2023

View Correspondence Network for Implicit Light Field Representation

We present a novel technique for implicit neural representation of light...
research
04/06/2023

DeLiRa: Self-Supervised Depth, Light, and Radiance Fields

Differentiable volumetric rendering is a powerful paradigm for 3D recons...
research
10/01/2020

X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation

We suggest to represent an X-Field -a set of 2D images taken across diff...
research
04/14/2022

Modeling Indirect Illumination for Inverse Rendering

Recent advances in implicit neural representations and differentiable re...
research
12/07/2020

NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis

We present a method that takes as input a set of images of a scene illum...
research
12/19/2020

The importance of silhouette optimization in 3D shape reconstruction system from multiple object scenes

This paper presents a multi stage 3D shape reconstruction system of mult...

Please sign up or login with your details

Forgot password? Click here to reset