Some Statistic and Information-theoretic Results On Arithmetic Average Fusion
Finite mixture such as the Gaussian mixture is a flexible and powerful probabilistic modeling tool for representing the multimodal distribution widely involved in many estimation and learning problems. The core of it is representing the target distribution by the arithmetic average (AA) of a finite number of sub-distributions which constitute the mixture. The AA fusion has demonstrated compelling performance for both single-sensor and multi-sensor estimator design. In this paper, some statistic and information-theoretic results are given on the AA fusion approach, including its covariance consistency, mean square error, mode-preservation capacity, mixture information divergence and principles for fusing/mixing weight design. In particular, based on the concept of conservative fusion, the relationship of the AA fusion with the existing covariance union, covariance intersection and diffusion combination approaches is exposed. Linear Gaussian models are considered for illustration.
READ FULL TEXT