Restoring Spatially-Heterogeneous Distortions using Mixture of Experts Network

09/30/2020
by   Sijin Kim, et al.
0

In recent years, deep learning-based methods have been successfully applied to the image distortion restoration tasks. However, scenarios that assume a single distortion only may not be suitable for many real-world applications. To deal with such cases, some studies have proposed sequentially combined distortions datasets. Viewing in a different point of combining, we introduce a spatially-heterogeneous distortion dataset in which multiple corruptions are applied to the different locations of each image. In addition, we also propose a mixture of experts network to effectively restore a multi-distortion image. Motivated by the multi-task learning, we design our network to have multiple paths that learn both common and distortion-specific representations. Our model is effective for restoring real-world distortions and we experimentally verify that our method outperforms other models designed to manage both single distortion and multiple distortions.

READ FULL TEXT

page 6

page 11

page 13

research
06/20/2021

Heterogeneous Multi-task Learning with Expert Diversity

Predicting multiple heterogeneous biological and medical targets is a ch...
research
12/03/2018

Attention-based Adaptive Selection of Operations for Image Restoration in the Presence of Unknown Combined Distortions

Many studies have been conducted so far on image restoration, the proble...
research
07/20/2022

Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model

Image restoration algorithms for atmospheric turbulence are known to be ...
research
08/17/2023

SimFIR: A Simple Framework for Fisheye Image Rectification with Self-supervised Representation Learning

In fisheye images, rich distinct distortion patterns are regularly distr...
research
12/08/2022

Surround-view Fisheye BEV-Perception for Valet Parking: Dataset, Baseline and Distortion-insensitive Multi-task Framework

Surround-view fisheye perception under valet parking scenes is fundament...
research
03/13/2023

Learning Distortion Invariant Representation for Image Restoration from A Causality Perspective

In recent years, we have witnessed the great advancement of Deep neural ...
research
12/20/2022

RepMode: Learning to Re-parameterize Diverse Experts for Subcellular Structure Prediction

In subcellular biological research, fluorescence staining is a key techn...

Please sign up or login with your details

Forgot password? Click here to reset