Evolvement Constrained Adversarial Learning for Video Style Transfer

11/06/2018
by   Wenbo Li, et al.
0

Video style transfer is a useful component for applications such as augmented reality, non-photorealistic rendering, and interactive games. Many existing methods use optical flow to preserve the temporal smoothness of the synthesized video. However, the estimation of optical flow is sensitive to occlusions and rapid motions. Thus, in this work, we introduce a novel evolve-sync loss computed by evolvements to replace optical flow. Using this evolve-sync loss, we build an adversarial learning framework, termed as Video Style Transfer Generative Adversarial Network (VST-GAN), which improves upon the MGAN method for image style transfer for more efficient video style transfer. We perform extensive experimental evaluations of our method and show quantitative and qualitative improvements over the state-of-the-art methods.

READ FULL TEXT
research
07/10/2020

Optical Flow Distillation: Towards Efficient and Stable Video Style Transfer

Video style transfer techniques inspire many exciting applications on mo...
research
05/26/2016

DeepMovie: Using Optical Flow and Deep Neural Networks to Stylize Movies

A recent paper by Gatys et al. describes a method for rendering an image...
research
05/05/2017

Characterizing and Improving Stability in Neural Style Transfer

Recent progress in style transfer on images has focused on improving the...
research
12/19/2022

ColoristaNet for Photorealistic Video Style Transfer

Photorealistic style transfer aims to transfer the artistic style of an ...
research
09/17/2020

Arbitrary Video Style Transfer via Multi-Channel Correlation

Video style transfer is getting more attention in AI community for its n...
research
03/31/2021

Rethinking Style Transfer: From Pixels to Parameterized Brushstrokes

There have been many successful implementations of neural style transfer...
research
02/01/2022

Stay Positive: Non-Negative Image Synthesis for Augmented Reality

In applications such as optical see-through and projector augmented real...

Please sign up or login with your details

Forgot password? Click here to reset