WSSL: Weighted Self-supervised Learning Framework For Image-inpainting

11/25/2022
by   Shubham Gupta, et al.
0

Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to capture the global context of the image, resulting in a visually unappealing result. We propose a novel self-supervised learning framework for image-inpainting: Weighted Self-Supervised Learning (WSSL) to tackle these problems. We designed WSSL to learn features from multiple weighted pretext tasks. These features are then utilized for the downstream task, image-inpainting. To improve the performance of our framework and produce more visually appealing images, we also present a novel loss function for image inpainting. The loss function takes advantage of both reconstruction loss and perceptual loss functions to regenerate the image. Our experimentation shows WSSL outperforms previous methods, and our loss function helps produce better results.

READ FULL TEXT

page 2

page 7

research
11/09/2022

Interactive Feature Embedding for Infrared and Visible Image Fusion

General deep learning-based methods for infrared and visible image fusio...
research
06/26/2020

Region-of-interest guided Supervoxel Inpainting for Self-supervision

Self-supervised learning has proven to be invaluable in making best use ...
research
11/14/2021

Auxiliary Loss Adaption for Image Inpainting

Auxiliary losses commonly used in image inpainting lead to better recons...
research
06/13/2023

Self-supervised Deep Hyperspectral Inpainting with the Sparsity and Low-Rank Considerations

Hyperspectral images are typically composed of hundreds of narrow and co...
research
10/14/2022

Data-Limited Tissue Segmentation using Inpainting-Based Self-Supervised Learning

Although supervised learning has enabled high performance for image segm...
research
02/28/2020

Instance Separation Emerges from Inpainting

Deep neural networks trained to inpaint partially occluded images show a...
research
02/21/2022

Self-Supervised Bulk Motion Artifact Removal in Optical Coherence Tomography Angiography

Optical coherence tomography angiography (OCTA) is an important imaging ...

Please sign up or login with your details

Forgot password? Click here to reset