Regularized Adaptation for Stable and Efficient Continuous-Level Learning

03/11/2020
by   Hyeongmin Lee, et al.
4

In Convolutional Neural Network (CNN) based image processing, most of the studies propose networks that are optimized for a single-level (or a single-objective); thus, they underperform on other levels and must be retrained for delivery of optimal performance. Using multiple models to cover multiple levels involves very high computational costs. To solve these problems, recent approaches train the networks on two different levels and propose their own interpolation methods to enable the arbitrary intermediate levels. However, many of them fail to adapt hard tasks or interpolate smoothly, or the others still require large memory and computational cost. In this paper, we propose a novel continuous-level learning framework using a Filter Transition Network (FTN) which is a non-linear module that easily adapt to new levels, and is regularized to prevent undesirable side-effects. Additionally, for stable learning of FTN, we newly propose a method to initialize non-linear CNNs with identity mappings. Furthermore, FTN is extremely lightweight module since it is a data-independent module, which means it is not affected by the spatial resolution of the inputs. Extensive results for various image processing tasks indicate that the performance of FTN is stable in terms of adaptation and interpolation, and comparable to that of the other heavy frameworks.

READ FULL TEXT

page 2

page 5

page 10

page 13

page 14

research
03/11/2020

Regularized Adaptation for Stable and Efficient Continuous-Level Learning on Image Processing Networks

In Convolutional Neural Network (CNN) based image processing, most of th...
research
10/05/2020

Smoother Network Tuning and Interpolation for Continuous-level Image Processing

In Convolutional Neural Network (CNN) based image processing, most studi...
research
12/17/2021

Procedural Kernel Networks

In the last decade Convolutional Neural Networks (CNNs) have defined the...
research
04/17/2019

Modulating Image Restoration with Continual Levels via Adaptive Feature Modification Layers

In image restoration tasks, learning from discrete and fixed restoration...
research
07/03/2020

RSAC: Regularized Subspace Approximation Classifier for Lightweight Continuous Learning

Continuous learning seeks to perform the learning on the data that arriv...
research
03/29/2023

Real-time Controllable Denoising for Image and Video

Controllable image denoising aims to generate clean samples with human p...
research
04/24/2023

Efficient Halftoning via Deep Reinforcement Learning

Halftoning aims to reproduce a continuous-tone image with pixels whose i...

Please sign up or login with your details

Forgot password? Click here to reset