C-SURE: Shrinkage Estimator and Prototype Classifier for Complex-Valued Deep Learning

06/22/2020
by   Yifei Xing, et al.
0

The James-Stein (JS) shrinkage estimator is a biased estimator that captures the mean of Gaussian random vectors.While it has a desirable statistical property of dominance over the maximum likelihood estimator (MLE) in terms of mean squared error (MSE), not much progress has been made on extending the estimator onto manifold-valued data. We propose C-SURE, a novel Stein's unbiased risk estimate (SURE) of the JS estimator on the manifold of complex-valued data with a theoretically proven optimum over MLE. Adapting the architecture of the complex-valued SurReal classifier, we further incorporate C-SURE into a prototype convolutional neural network (CNN) classifier. We compare C-SURE with SurReal and a real-valued baseline on complex-valued MSTAR and RadioML datasets. C-SURE is more accurate and robust than SurReal, and the shrinkage estimator is always better than MLE for the same prototype classifier. Like SurReal, C-SURE is much smaller, outperforming the real-valued baseline on MSTAR (RadioML) with less than 1 percent (3 percent) of the baseline size

READ FULL TEXT

page 2

page 6

research
08/22/2022

Widely-Linear MMSE Estimation of Complex-Valued Graph Signals

In this paper, we consider the problem of recovering random graph signal...
research
07/04/2020

An Empirical Bayes Approach to Shrinkage Estimation on the Manifold of Symmetric Positive-Definite Matrices

The James-Stein estimator is an estimator of the multivariate normal mea...
research
10/17/2018

Shrinkage estimation of rate statistics

This paper presents a simple shrinkage estimator of rates based on Bayes...
research
06/24/2019

SurReal: Fréchet Mean and Distance Transform for Complex-Valued Deep Learning

We develop a novel deep learning architecture for naturally complex-valu...
research
07/13/2022

Shrinkage Estimation of Higher Order Bochner Integrals

We consider shrinkage estimation of higher order Hilbert space valued Bo...
research
07/28/2016

A Nonlocal Denoising Algorithm for Manifold-Valued Images Using Second Order Statistics

Nonlocal patch-based methods, in particular the Bayes' approach of Lebru...
research
03/11/2015

A mathematical motivation for complex-valued convolutional networks

A complex-valued convolutional network (convnet) implements the repeated...

Please sign up or login with your details

Forgot password? Click here to reset