Dependence Maximizing Temporal Alignment via Squared-Loss Mutual Information

06/19/2012
by   Makoto Yamada, et al.
0

The goal of temporal alignment is to establish time correspondence between two sequences, which has many applications in a variety of areas such as speech processing, bioinformatics, computer vision, and computer graphics. In this paper, we propose a novel temporal alignment method called least-squares dynamic time warping (LSDTW). LSDTW finds an alignment that maximizes statistical dependency between sequences, measured by a squared-loss variant of mutual information. The benefit of this novel information-theoretic formulation is that LSDTW can align sequences with different lengths, different dimensionality, high non-linearity, and non-Gaussianity in a computationally efficient manner. In addition, model parameters such as an initial alignment matrix can be systematically optimized by cross-validation. We demonstrate the usefulness of LSDTW through experiments on synthetic and real-world Kinect action recognition datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/03/2011

Information-Maximization Clustering based on Squared-Loss Mutual Information

Information-maximization clustering learns a probabilistic classifier in...
research
03/05/2023

MITFAS: Mutual Information based Temporal Feature Alignment and Sampling for Aerial Video Action Recognition

We present a novel approach for action recognition in UAV videos. Our fo...
research
07/15/2018

The Globally Optimal Reparameterization Algorithm: an Alternative to Fast Dynamic Time Warping for Action Recognition in Video Sequences

Signal alignment has become a popular problem in robotics due in part to...
research
09/19/2021

Multiscale Manifold Warping

Many real-world applications require aligning two temporal sequences, in...
research
10/30/2018

Feature Trajectory Dynamic Time Warping for Clustering of Speech Segments

Dynamic time warping (DTW) can be used to compute the similarity between...
research
05/10/2018

Fundamental Limits of Database Alignment

We consider the problem of aligning a pair of databases with correlated ...
research
06/28/2021

Fast computation of mutual information in the frequency domain with applications to global multimodal image alignment

Multimodal image alignment is the process of finding spatial corresponde...

Please sign up or login with your details

Forgot password? Click here to reset