Fully Automatic Video Colorization with Self-Regularization and Diversity

08/04/2019
by   Chenyang Lei, et al.
2

We present a fully automatic approach to video colorization with self-regularization and diversity. Our model contains a colorization network for video frame colorization and a refinement network for spatiotemporal color refinement. Without any labeled data, both networks can be trained with self-regularized losses defined in bilateral and temporal space. The bilateral loss enforces color consistency between neighboring pixels in a bilateral space and the temporal loss imposes constraints between corresponding pixels in two nearby frames. While video colorization is a multi-modal problem, our method uses a perceptual loss with diversity to differentiate various modes in the solution space. Perceptual experiments demonstrate that our approach outperforms state-of-the-art approaches on fully automatic video colorization. The results are shown in the supplementary video at https://youtu.be/Y15uv2jnK-4

READ FULL TEXT

page 2

page 3

page 5

page 7

page 8

research
08/25/2023

Direction-aware Video Demoireing with Temporal-guided Bilateral Learning

Moire patterns occur when capturing images or videos on screens, severel...
research
03/31/2021

Learning by Aligning Videos in Time

We present a self-supervised approach for learning video representations...
research
03/27/2018

Diversity Regularized Spatiotemporal Attention for Video-based Person Re-identification

Video-based person re-identification matches video clips of people acros...
research
04/26/2021

VCGAN: Video Colorization with Hybrid Generative Adversarial Network

We propose a hybrid recurrent Video Colorization with Hybrid Generative ...
research
10/09/2021

Temporally Consistent Video Colorization with Deep Feature Propagation and Self-regularization Learning

Video colorization is a challenging and highly ill-posed problem. Althou...
research
10/24/2021

Perceptual Consistency in Video Segmentation

In this paper, we present a novel perceptual consistency perspective on ...
research
01/07/2021

VHS to HDTV Video Translation using Multi-task Adversarial Learning

There are large amount of valuable video archives in Video Home System (...

Please sign up or login with your details

Forgot password? Click here to reset