Fast Satellite Tensorial Radiance Field for Multi-date Satellite Imagery of Large Size

09/21/2023
by   Tongtong Zhang, et al.
0

Existing NeRF models for satellite images suffer from slow speeds, mandatory solar information as input, and limitations in handling large satellite images. In response, we present SatensoRF, which significantly accelerates the entire process while employing fewer parameters for satellite imagery of large size. Besides, we observed that the prevalent assumption of Lambertian surfaces in neural radiance fields falls short for vegetative and aquatic elements. In contrast to the traditional hierarchical MLP-based scene representation, we have chosen a multiscale tensor decomposition approach for color, volume density, and auxiliary variables to model the lightfield with specular color. Additionally, to rectify inconsistencies in multi-date imagery, we incorporate total variation loss to restore the density tensor field and treat the problem as a denosing task.To validate our approach, we conducted assessments of SatensoRF using subsets from the spacenet multi-view dataset, which includes both multi-date and single-date multi-view RGB images. Our results clearly demonstrate that SatensoRF surpasses the state-of-the-art Sat-NeRF series in terms of novel view synthesis performance. Significantly, SatensoRF requires fewer parameters for training, resulting in faster training and inference speeds and reduced computational demands.

READ FULL TEXT

page 1

page 8

page 10

page 11

page 12

page 13

research
03/16/2022

Sat-NeRF: Learning Multi-View Satellite Photogrammetry With Transient Objects and Shadow Modeling Using RPC Cameras

We introduce the Satellite Neural Radiance Field (Sat-NeRF), a new end-t...
research
03/26/2023

Sat2Density: Faithful Density Learning from Satellite-Ground Image Pairs

This paper aims to develop an accurate 3D geometry representation of sat...
research
10/07/2019

Leveraging Vision Reconstruction Pipelines for Satellite Imagery

Reconstructing 3D geometry from satellite imagery is an important topic ...
research
08/24/2020

Semantic Labeling of Large-Area Geographic Regions Using Multi-View and Multi-Date Satellite Images, and Noisy OSM Training Labels

We present a novel multi-view training framework and CNN architecture fo...
research
08/02/2023

Incorporating Season and Solar Specificity into Renderings made by a NeRF Architecture using Satellite Images

As a result of Shadow NeRF and Sat-NeRF, it is possible to take the sola...
research
11/05/2021

Seamless Satellite-image Synthesis

We introduce Seamless Satellite-image Synthesis (SSS), a novel neural ar...
research
03/01/2021

Automatic Stockpile Volume Monitoring using Multi-view Stereo from SkySat Imagery

This paper proposes a system for automatic surface volume monitoring fro...

Please sign up or login with your details

Forgot password? Click here to reset