A Dataset-free Self-supervised Disentangled Learning Method for Adaptive Infrared and Visible Images Super-resolution Fusion

12/06/2021
by   Yuanjie Gu, et al.
7

This study proposes a novel general dataset-free self-supervised learning framework based-on physical model named self-supervised disentangled learning (SDL), and proposes a novel method named Deep Retinex fusion (DRF) which applies SDL framework with generative networks and Retinex theory in infrared and visible images super-resolution fusion. Meanwhile, a generative dual-path fusion network ZipperNet and adaptive fusion loss function Retinex loss are designed for effectively high-quality fusion. The core idea of DRF (based-on SDL) consists of two parts: one is generating components which are disentangled from physical model using generative networks; the other is loss functions which are designed based-on physical relation, and generated components are combined by loss functions in training phase. Furthermore, in order to verify the effectiveness of our proposed DRF, qualitative and quantitative comparisons compared with six state-of-the-art methods are performed on three different infrared and visible datasets. Our code will be open source available soon at https://github.com/GuYuanjie/Deep-Retinex-fusion.

READ FULL TEXT

page 1

page 2

page 5

page 6

page 7

page 9

research
11/09/2022

Interactive Feature Embedding for Infrared and Visible Image Fusion

General deep learning-based methods for infrared and visible image fusio...
research
10/12/2021

Deep Fusion Prior for Multi-Focus Image Super Resolution Fusion

This paper unifies the multi-focus images fusion (MFIF) and blind super ...
research
12/04/2020

Super-Selfish: Self-Supervised Learning on Images with PyTorch

Super-Selfish is an easy to use PyTorch framework for image-based self-s...
research
07/09/2023

Visible and infrared self-supervised fusion trained on a single example

This paper addresses the problem of visible (RGB) to Near-Infrared (NIR)...
research
03/20/2023

A Dual-branch Self-supervised Representation Learning Framework for Tumour Segmentation in Whole Slide Images

Supervised deep learning methods have achieved considerable success in m...
research
03/16/2019

Robust Super-Resolution GAN, with Manifold-based and Perception Loss

Super-resolution using deep neural networks typically relies on highly c...
research
07/27/2023

A full-resolution training framework for Sentinel-2 image fusion

This work presents a new unsupervised framework for training deep learni...

Please sign up or login with your details

Forgot password? Click here to reset