Deep Iterative Frame Interpolation for Full-frame Video Stabilization

09/05/2019
by   Jinsoo Choi, et al.
14

Video stabilization is a fundamental and important technique for higher quality videos. Prior works have extensively explored video stabilization, but most of them involve cropping of the frame boundaries and introduce moderate levels of distortion. We present a novel deep approach to video stabilization which can generate video frames without cropping and low distortion. The proposed framework utilizes frame interpolation techniques to generate in between frames, leading to reduced inter-frame jitter. Once applied in an iterative fashion, the stabilization effect becomes stronger. A major advantage is that our framework is end-to-end trainable in an unsupervised manner. In addition, our method is able to run in near real-time (15 fps). To the best of our knowledge, this is the first work to propose an unsupervised deep approach to full-frame video stabilization. We show the advantages of our method through quantitative and qualitative evaluations comparing to the state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

page 8

research
06/04/2017

Deep Frame Interpolation

This work presents a supervised learning based approach to the computer ...
research
05/14/2020

W-Cell-Net: Multi-frame Interpolation of Cellular Microscopy Videos

Deep Neural Networks are increasingly used in video frame interpolation ...
research
03/01/2021

FineNet: Frame Interpolation and Enhancement for Face Video Deblurring

The objective of this work is to deblur face videos. We propose a method...
research
07/04/2018

Video Frame Interpolation by Plug-and-Play Deep Locally Linear Embedding

We propose a generative framework which takes on the video frame interpo...
research
11/02/2020

Revisiting Adaptive Convolutions for Video Frame Interpolation

Video frame interpolation, the synthesis of novel views in time, is an i...
research
05/11/2023

Inter-frame Accelerate Attack against Video Interpolation Models

Deep learning based video frame interpolation (VIF) method, aiming to sy...
research
06/08/2018

Convolutional Video Steganography with Temporal Residual Modeling

Steganography represents the art of unobtrusively concealing a secrete m...

Please sign up or login with your details

Forgot password? Click here to reset