Advanced Underwater Image Restoration in Complex Illumination Conditions

09/05/2023
by   Yifan Song, et al.
0

Underwater image restoration has been a challenging problem for decades since the advent of underwater photography. Most solutions focus on shallow water scenarios, where the scene is uniformly illuminated by the sunlight. However, the vast majority of uncharted underwater terrain is located beyond 200 meters depth where natural light is scarce and artificial illumination is needed. In such cases, light sources co-moving with the camera, dynamically change the scene appearance, which make shallow water restoration methods inadequate. In particular for multi-light source systems (composed of dozens of LEDs nowadays), calibrating each light is time-consuming, error-prone and tedious, and we observe that only the integrated illumination within the viewing volume of the camera is critical, rather than the individual light sources. The key idea of this paper is therefore to exploit the appearance changes of objects or the seafloor, when traversing the viewing frustum of the camera. Through new constraints assuming Lambertian surfaces, corresponding image pixels constrain the light field in front of the camera, and for each voxel a signal factor and a backscatter value are stored in a volumetric grid that can be used for very efficient image restoration of camera-light platforms, which facilitates consistently texturing large 3D models and maps that would otherwise be dominated by lighting and medium artifacts. To validate the effectiveness of our approach, we conducted extensive experiments on simulated and real-world datasets. The results of these experiments demonstrate the robustness of our approach in restoring the true albedo of objects, while mitigating the influence of lighting and medium effects. Furthermore, we demonstrate our approach can be readily extended to other scenarios, including in-air imaging with artificial illumination or other similar cases.

READ FULL TEXT
research
09/05/2021

Underwater 3D Reconstruction Using Light Fields

Underwater 3D reconstruction is challenging due to the refraction of lig...
research
10/01/2021

Robustly Removing Deep Sea Lighting Effects for Visual Mapping of Abyssal Plains

The majority of Earth's surface lies deep in the oceans, where no surfac...
research
12/06/2015

The Next Best Underwater View

To image in high resolution large and occlusion-prone scenes, a camera m...
research
12/22/2020

Underwater image filtering: methods, datasets and evaluation

Underwater images are degraded by the selective attenuation of light tha...
research
04/06/2023

Beyond NeRF Underwater: Learning Neural Reflectance Fields for True Color Correction of Marine Imagery

Underwater imagery often exhibits distorted coloration as a result of li...
research
04/16/2023

SeaThru-NeRF: Neural Radiance Fields in Scattering Media

Research on neural radiance fields (NeRFs) for novel view generation is ...
research
03/07/2023

Weakly Supervised Caveline Detection For AUV Navigation Inside Underwater Caves

Underwater caves are challenging environments that are crucial for water...

Please sign up or login with your details

Forgot password? Click here to reset