Reconstructing Images of Two Adjacent Objects through Scattering Medium Using Generative Adversarial Network

07/24/2021
by   Xuetian Lai, et al.
4

Reconstruction of image by using convolutional neural networks (CNNs) has been vigorously studied in the last decade. Until now, there have being developed several techniques for imaging of a single object through scattering medium by using neural networks, however how to reconstruct images of more than one object simultaneously seems hard to realize. In this paper, we demonstrate an approach by using generative adversarial network (GAN) to reconstruct images of two adjacent objects through scattering media. We construct an imaging system for imaging of two adjacent objects behind the scattering media. In general, as the light field of two adjacent object images pass through the scattering slab, a speckle pattern is obtained. The designed adversarial network, which is called as YGAN, is employed to reconstruct the images simultaneously. It is shown that based on the trained YGAN, we can reconstruct images of two adjacent objects from one speckle pattern with high fidelity. In addition, we study the influence of the object image types, and the distance between the two adjacent objects on the fidelity of the reconstructed images. Moreover even if another scattering medium is inserted between the two objects, we can also reconstruct the images of two objects from a speckle with high quality. The technique presented in this work can be used for applications in areas of medical image analysis, such as medical image classification, segmentation, and studies of multi-object scattering imaging etc.

READ FULL TEXT

page 3

page 6

page 7

page 8

research
10/20/2019

Learning-based real-time method to looking through scattering medium oriented to practical application

Strong scattering media brings great difficulties to optical imaging, wh...
research
09/19/2018

Deep Hybrid Scattering Image Learning

A well-trained deep neural network is shown to gain capability of simult...
research
08/09/2017

Exploit imaging through opaque wall via deep learning

Imaging through scattering media is encountered in many disciplines or s...
research
04/04/2023

High-resolution tomographic reconstruction of optical absorbance through scattering media using neural fields

Light scattering imposes a major obstacle for imaging objects seated dee...
research
07/03/2021

SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network

Single-pixel imaging is a novel imaging scheme that has gained popularit...
research
06/12/2019

GANPOP: Generative Adversarial Network Prediction of Optical Properties from Single Snapshot Wide-field Images

We present a deep learning framework for wide-field, content-aware estim...
research
03/19/2022

Modelling nonlinear dependencies in the latent space of inverse scattering

The problem of inverse scattering proposed by Angles and Mallat in 2018,...

Please sign up or login with your details

Forgot password? Click here to reset