Performance Limits on the Classification of Kronecker-structured Models
Kronecker-structured (K-S) models recently have been proposed for the efficient representation, processing, and classification of multidimensional signals such as images and video. Because they are tailored to the multi-dimensional structure of the target images, K-S models show improved performance in compression and reconstruction over more general (union of) subspace models. In this paper, we study the classification performance of Kronecker-structured models in two asymptotic regimes. First, we study the diversity order, the slope of the error probability as the signal noise power goes to zero. We derive an exact expression for the diversity order as a function of the signal and subspace dimensions of a K-S model. Next, we study the classification capacity, the maximum rate at which the number of classes can grow as the signal dimension goes to infinity. We derive upper and lower bounds on the prelog factor of the classification capacity. Finally, we evaluate the empirical classification performance of K-S models for both the synthetic and the real world data, showing that they agree with the diversity order analysis.
READ FULL TEXT