Deep Network Interpolation for Continuous Imagery Effect Transition

11/26/2018
by   Xintao Wang, et al.
29

Deep convolutional neural network has demonstrated its capability of learning a deterministic mapping for the desired imagery effect. However, the large variety of user flavors motivates the possibility of continuous transition among different output effects. Unlike existing methods that require a specific design to achieve one particular transition (e.g., style transfer), we propose a simple yet universal approach to attain a smooth control of diverse imagery effects in many low-level vision tasks, including image restoration, image-to-image translation, and style transfer. Specifically, our method, namely Deep Network Interpolation (DNI), applies linear interpolation in the parameter space of two or more correlated networks. A smooth control of imagery effects can be achieved by tweaking the interpolation coefficients. In addition to DNI and its broad applications, we also investigate the mechanism of network interpolation from the perspective of learned filters.

READ FULL TEXT

page 1

page 6

page 7

page 8

page 12

page 15

page 16

page 17

research
01/18/2017

Bringing Impressionism to Life with Neural Style Transfer in Come Swim

Neural Style Transfer is a striking, recently-developed technique that u...
research
07/04/2018

Unbiased Decoder Learning for Fast Image Style Transfer

Image style transfer is one of the computer vision applications related ...
research
07/04/2018

Unbiased Image Style Transfer

Recent fast image style transferring methods use feed-forward neural net...
research
07/15/2020

Filter Style Transfer between Photos

Over the past few years, image-to-image style transfer has risen to the ...
research
03/18/2022

Beyond a Video Frame Interpolator: A Space Decoupled Learning Approach to Continuous Image Transition

Video frame interpolation (VFI) aims to improve the temporal resolution ...
research
10/05/2020

Smoother Network Tuning and Interpolation for Continuous-level Image Processing

In Convolutional Neural Network (CNN) based image processing, most studi...
research
03/11/2020

Regularized Adaptation for Stable and Efficient Continuous-Level Learning on Image Processing Networks

In Convolutional Neural Network (CNN) based image processing, most of th...

Please sign up or login with your details

Forgot password? Click here to reset