Fast and stable modification of the Gauss-Newton method for low-rank signal estimation

06/27/2021
by   Nikita Zvonarev, et al.
0

The weighted nonlinear least-squares problem for low-rank signal estimation is considered. The problem of constructing a numerical solution that is stable and fast for long time series is addressed. A modified weighted Gauss-Newton method, which can be implemented through the direct variable projection onto a space of low-rank signals, is proposed. For a weight matrix which provides the maximum likelihood estimator of the signal in the presence of autoregressive noise of order p the computational cost of iterations is O(N r^2 + N p^2 + r N log N) as N tends to infinity, where N is the time-series length, r is the rank of the approximating time series. Moreover, the proposed method can be applied to data with missing values, without increasing the computational cost. The method is compared with state-of-the-art methods based on the variable projection approach in terms of floating-point numerical stability and computational cost.

READ FULL TEXT
research
01/24/2021

Low-rank signal subspace: parameterization, projection and signal estimation

The paper contains several theoretical results related to the weighted n...
research
08/06/2018

Regularized matrix data clustering and its application to image analysis

In this paper, we propose a regularized mixture probabilistic model to c...
research
05/27/2020

PNKH-B: A Projected Newton-Krylov Method for Large-Scale Bound-Constrained Optimization

We present PNKH-B, a projected Newton-Krylov method with a low-rank appr...
research
10/01/2017

Efficient Preconditioning for Noisy Separable NMFs by Successive Projection Based Low-Rank Approximations

The successive projection algorithm (SPA) can quickly solve a nonnegativ...
research
02/25/2020

Block Hankel Tensor ARIMA for Multiple Short Time Series Forecasting

This work proposes a novel approach for multiple time series forecasting...
research
06/09/2019

Fast Cadzow's Algorithm and a Gradient Variant

The Cadzow's algorithm is a signal denoising and recovery method which w...
research
03/08/2020

Nonlinear least-squares spline fitting with variable knots

In this paper, we present a nonlinear least-squares fitting algorithm us...

Please sign up or login with your details

Forgot password? Click here to reset