Adaptively Meshed Video Stabilization

06/14/2020
by   Minda Zhao, et al.
0

Video stabilization is essential for improving visual quality of shaky videos. The current video stabilization methods usually take feature trajectories in the background to estimate one global transformation matrix or several transformation matrices based on a fixed mesh, and warp shaky frames into their stabilized views. However, these methods may not model the shaky camera motion well in complicated scenes, such as scenes containing large foreground objects or strong parallax, and may result in notable visual artifacts in the stabilized videos. To resolve the above issues, this paper proposes an adaptively meshed method to stabilize a shaky video based on all of its feature trajectories and an adaptive blocking strategy. More specifically, we first extract feature trajectories of the shaky video and then generate a triangle mesh according to the distribution of the feature trajectories in each frame. Then transformations between shaky frames and their stabilized views over all triangular grids of the mesh are calculated to stabilize the shaky video. Since more feature trajectories can usually be extracted from all regions, including both background and foreground regions, a finer mesh will be obtained and provided for camera motion estimation and frame warping. We estimate the mesh-based transformations of each frame by solving a two-stage optimization problem. Moreover, foreground and background feature trajectories are no longer distinguished and both contribute to the estimation of the camera motion in the proposed optimization problem, which yields better estimation performance than previous works, particularly in challenging videos with large foreground objects or strong parallax.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 10

page 12

page 13

research
03/06/2019

Robust Video Background Identification by Dominant Rigid Motion Estimation

The ability to identify the static background in videos captured by a mo...
research
12/08/2016

A Maximum A Posteriori Estimation Framework for Robust High Dynamic Range Video Synthesis

High dynamic range (HDR) image synthesis from multiple low dynamic range...
research
06/30/2015

Long-Range Motion Trajectories Extraction of Articulated Human Using Mesh Evolution

This letter presents a novel approach to extract reliable dense and long...
research
06/06/2023

YONA: You Only Need One Adjacent Reference-frame for Accurate and Fast Video Polyp Detection

Accurate polyp detection is essential for assisting clinical rectal canc...
research
06/27/2019

Optimizing for Aesthetically Pleasing Quadrotor Camera Motion

In this paper we first contribute a large scale online study (N=400) to ...
research
07/13/2017

Disentangling Motion, Foreground and Background Features in Videos

This paper introduces an unsupervised framework to extract semantically ...
research
06/21/2020

Lyric Video Analysis Using Text Detection and Tracking

We attempt to recognize and track lyric words in lyric videos. Lyric vid...

Please sign up or login with your details

Forgot password? Click here to reset