TSAMT: Time-Series-Analysis-based Motion Transfer among Multiple Cameras

09/29/2021
by   Yaping Zhao, et al.
0

Along with advances in optical sensors is the common practice of building an imaging system with heterogeneous cameras. While high-resolution (HR) videos acquisition and analysis are benefited from hybrid sensors, the intrinsic characteristics of multiple cameras lead to an interesting motion transfer problem. Unfortunately, most of the existing methods provide no theoretical analysis and require intensive training data. In this paper, we propose an algorithm using time series analysis for motion transfer among multiple cameras. Specifically, we firstly identify seasonality in motion data and then build an addictive time series model to extract patterns that could be transferred across cameras. Our approach has a complete and clear mathematical formulation, thus being efficient and interpretable. Through quantitative evaluations on real-world data, we demonstrate the effectiveness of our method. Furthermore, our motion transfer algorithm could combine with and facilitate downstream tasks, e.g., enhancing pose estimation on LR videos with inherent patterns extracted from HR ones. Code is available at https://github.com/IndigoPurple/TSAMT.

READ FULL TEXT

page 1

page 2

page 7

research
07/16/2022

TransGrasp: Grasp Pose Estimation of a Category of Objects by Transferring Grasps from Only One Labeled Instance

Grasp pose estimation is an important issue for robots to interact with ...
research
07/09/2022

Training Robust Deep Models for Time-Series Domain: Novel Algorithms and Theoretical Analysis

Despite the success of deep neural networks (DNNs) for real-world applic...
research
10/17/2022

Event-based Stereo Depth Estimation from Ego-motion using Ray Density Fusion

Event cameras are bio-inspired sensors that mimic the human retina by re...
research
05/27/2020

Zoom in to the details of human-centric videos

Presenting high-resolution (HR) human appearance is always critical for ...
research
07/09/2022

Dynamic Time Warping based Adversarial Framework for Time-Series Domain

Despite the rapid progress on research in adversarial robustness of deep...
research
05/24/2020

Learning Camera Miscalibration Detection

Self-diagnosis and self-repair are some of the key challenges in deployi...
research
12/28/2020

Computational Analysis of Subscapularis Tears and Pectoralis Major Transfers on Muscular Activity

Muscle transfers are commonly performed to restore joint function after ...

Please sign up or login with your details

Forgot password? Click here to reset