Multi-Task Learning Enhanced Single Image De-Raining

03/21/2020
by   YuLong Fan, et al.
6

Rain removal in images is an important task in computer vision filed and attracting attentions of more and more people. In this paper, we address a non-trivial issue of removing visual effect of rain streak from a single image. Differing from existing work, our method combines various semantic constraint task in a proposed multi-task regression model for rain removal. These tasks reinforce the model's capabilities from the content, edge-aware, and local texture similarity respectively. To further improve the performance of multi-task learning, we also present two simple but powerful dynamic weighting algorithms. The proposed multi-task enhanced network (MENET) is a powerful convolutional neural network based on U-Net for rain removal research, with a specific focus on utilize multiple tasks constraints and exploit the synergy among them to facilitate the model's rain removal capacity. It is noteworthy that the adaptive weighting scheme has further resulted in improved network capability. We conduct several experiments on synthetic and real rain images, and achieve superior rain removal performance over several selected state-of-the-art (SOTA) approaches. The overall effect of our method is impressive, even in the decomposition of heavy rain and rain streak accumulation.The source code and some results can be found at:https://github.com/SumiHui/MENET.

READ FULL TEXT

page 1

page 6

page 9

page 10

page 11

page 12

page 13

page 14

research
04/08/2018

Fast Single Image Rain Removal via a Deep Decomposition-Composition Network

Rain effect in images typically is annoying for many multimedia and comp...
research
10/25/2021

AutoMTL: A Programming Framework for Automated Multi-Task Learning

Multi-task learning (MTL) jointly learns a set of tasks. It is a promisi...
research
03/27/2022

LibMTL: A Python Library for Multi-Task Learning

This paper presents LibMTL, an open-source Python library built on PyTor...
research
09/18/2019

A Survey on Rain Removal from Video and Single Image

Rain streaks might severely degenerate the performance of video/image pr...
research
09/25/2016

Deep Joint Rain Detection and Removal from a Single Image

In this paper, we address a rain removal problem from a single image, ev...
research
05/10/2021

You Only Learn One Representation: Unified Network for Multiple Tasks

People “understand” the world via vision, hearing, tactile, and also the...
research
08/16/2021

Text-Aware Single Image Specular Highlight Removal

Removing undesirable specular highlight from a single input image is of ...

Please sign up or login with your details

Forgot password? Click here to reset