The Extended Kalman Filter is a Natural Gradient Descent in Trajectory Space

01/03/2019
by   Yann Ollivier, et al.
0

The extended Kalman filter is perhaps the most standard tool to estimate in real time the state of a dynamical system from noisy measurements of some function of the system, with extensive practical applications (such as position tracking via GPS). While the plain Kalman filter for linear systems is well-understood, the extended Kalman filter relies on linearizations which have been debated. We recover the exact extended Kalman filter equations from first principles in statistical learning: the extended Kalman filter is equal to Amari's online natural gradient, applied in the space of trajectories of the system. Namely, each possible trajectory of the dynamical system defines a probability law over possible observations. In principle this makes it possible to treat the underlying trajectory as the parameter of a statistical model of the observations. Then the parameter can be learned by gradient ascent on the log-likelihood of observations, as they become available. Using Amari's natural gradient from information geometry (a gradient descent preconditioned with the Fisher matrix, which provides parameterization-invariance) exactly recovers the extended Kalman filter. This applies only to a particular choice of process noise in the Kalman filter, namely, taking noise proportional to the posterior covariance - a canonical choice in the absence of specific model information.

READ FULL TEXT
research
03/01/2017

Online Natural Gradient as a Kalman Filter

We establish a full relationship between Kalman filtering and Amari's na...
research
07/23/2020

Mapping Distributions through Hybrid Dynamical Systems and its Application to Kalman Filtering

Many state estimation and control algorithms require knowledge of how pr...
research
08/23/2023

Extended Linear Regression: A Kalman Filter Approach for Minimizing Loss via Area Under the Curve

This research enhances linear regression models by integrating a Kalman ...
research
11/25/2021

Unscented Kalman Filter for Long-Distance Vessel Tracking in Geodetic Coordinates

This paper describes a novel tracking filter, designed primarily for use...
research
03/08/2016

Frequency estimation in three-phase power systems with harmonic contamination: A multistage quaternion Kalman filtering approach

Motivated by the need for accurate frequency information, a novel algori...
research
06/09/2022

Learning Vehicle Trajectory Uncertainty

The linear Kalman filter is commonly used for vehicle tracking. This fil...
research
05/27/2019

Kalman Filter, Sensor Fusion, and Constrained Regression: Equivalences and Insights

The Kalman filter (KF) is one of the most widely used tools for data ass...

Please sign up or login with your details

Forgot password? Click here to reset