A Matching Algorithm based on Image Attribute Transfer and Local Features for Underwater Acoustic and Optical Images

08/27/2021
by   Xiaoteng Zhou, et al.
12

In the field of underwater vision research, image matching between the sonar sensors and optical cameras has always been a challenging problem. Due to the difference in the imaging mechanism between them, which are the gray value, texture, contrast, etc. of the acoustic images and the optical images are also variant in local locations, which makes the traditional matching method based on the optical image invalid. Coupled with the difficulties and high costs of underwater data acquisition, it further affects the research process of acousto-optic data fusion technology. In order to maximize the use of underwater sensor data and promote the development of multi-sensor information fusion (MSIF), this study applies the image attribute transfer method based on deep learning approach to solve the problem of acousto-optic image matching, the core of which is to eliminate the imaging differences between them as much as possible. At the same time, the advanced local feature descriptor is introduced to solve the challenging acousto-optic matching problem. Experimental results show that our proposed method could preprocess acousto-optic images effectively and obtain accurate matching results. Additionally, the method is based on the combination of image depth semantic layer, and it could indirectly display the local feature matching relationship between original image pair, which provides a new solution to the underwater multi-sensor image matching problem.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

page 8

page 10

research
08/27/2021

Matching Underwater Sonar Images by the Learned Descriptor Based on Style Transfer Method

This paper proposes a method that combines the style transfer technique ...
research
11/10/2022

Learning Visual Representation of Underwater Acoustic Imagery Using Transformer-Based Style Transfer Method

Underwater automatic target recognition (UATR) has been a challenging re...
research
11/29/2021

Nonlinear Intensity Underwater Sonar Image Matching Method Based on Phase Information and Deep Convolution Features

In the field of deep-sea exploration, sonar is presently the only effici...
research
11/17/2021

Nonlinear Intensity Sonar Image Matching based on Deep Convolution Features

In the field of deep-sea exploration, sonar is presently the only effici...
research
04/14/2020

Parametric Design of Underwater Optical Systems

The design of optical systems for underwater vehicles is a complex proce...
research
03/27/2023

Automatic breach detection during spine pedicle drilling based on vibroacoustic sensing

Pedicle drilling is a complex and critical spinal surgery task. Detectin...
research
02/26/2019

Imaging and Classification Techniques for Seagrass Mapping and Monitoring: A Comprehensive Survey

Monitoring underwater habitats is a vital part of observing the conditio...

Please sign up or login with your details

Forgot password? Click here to reset