DeepAI AI Chat
Log In Sign Up

Adaptively Meshed Video Stabilization

06/14/2020
by   Minda Zhao, et al.
USTC
0

Video stabilization is essential for improving visual quality of shaky videos. The current video stabilization methods usually take feature trajectories in the background to estimate one global transformation matrix or several transformation matrices based on a fixed mesh, and warp shaky frames into their stabilized views. However, these methods may not model the shaky camera motion well in complicated scenes, such as scenes containing large foreground objects or strong parallax, and may result in notable visual artifacts in the stabilized videos. To resolve the above issues, this paper proposes an adaptively meshed method to stabilize a shaky video based on all of its feature trajectories and an adaptive blocking strategy. More specifically, we first extract feature trajectories of the shaky video and then generate a triangle mesh according to the distribution of the feature trajectories in each frame. Then transformations between shaky frames and their stabilized views over all triangular grids of the mesh are calculated to stabilize the shaky video. Since more feature trajectories can usually be extracted from all regions, including both background and foreground regions, a finer mesh will be obtained and provided for camera motion estimation and frame warping. We estimate the mesh-based transformations of each frame by solving a two-stage optimization problem. Moreover, foreground and background feature trajectories are no longer distinguished and both contribute to the estimation of the camera motion in the proposed optimization problem, which yields better estimation performance than previous works, particularly in challenging videos with large foreground objects or strong parallax.

READ FULL TEXT

page 2

page 3

page 5

page 6

page 7

page 10

page 12

page 13

03/06/2019

Robust Video Background Identification by Dominant Rigid Motion Estimation

The ability to identify the static background in videos captured by a mo...
12/08/2016

A Maximum A Posteriori Estimation Framework for Robust High Dynamic Range Video Synthesis

High dynamic range (HDR) image synthesis from multiple low dynamic range...
06/30/2015

Long-Range Motion Trajectories Extraction of Articulated Human Using Mesh Evolution

This letter presents a novel approach to extract reliable dense and long...
06/27/2019

Optimizing for Aesthetically Pleasing Quadrotor Camera Motion

In this paper we first contribute a large scale online study (N=400) to ...
05/28/2017

Robust Online Matrix Factorization for Dynamic Background Subtraction

We propose an effective online background subtraction method, which can ...
02/02/2015

Integrating Graph Partitioning and Matching for Trajectory Analysis in Video Surveillance

In order to track the moving objects in long range against occlusion, in...
03/10/2022

Adaptive Background Matting Using Background Matching

Due to the difficulty of solving the matting problem, lots of methods us...