Matrix Decomposition and Applications

by   Jun Lu, et al.

In 1954, Alston S. Householder published Principles of Numerical Analysis, one of the first modern treatments on matrix decomposition that favored a (block) LU decomposition-the factorization of a matrix into the product of lower and upper triangular matrices. And now, matrix decomposition has become a core technology in machine learning, largely due to the development of the back propagation algorithm in fitting a neural network. The sole aim of this survey is to give a self-contained introduction to concepts and mathematical tools in numerical linear algebra and matrix analysis in order to seamlessly introduce matrix decomposition techniques and their applications in subsequent sections. However, we clearly realize our inability to cover all the useful and interesting results concerning matrix decomposition and given the paucity of scope to present this discussion, e.g., the separated analysis of the Euclidean space, Hermitian space, Hilbert space, and things in the complex domain. We refer the reader to literature in the field of linear algebra for a more detailed introduction to the related fields.




page 2

page 3

page 11

page 14

page 16

page 17

page 29

page 32


Numerical Matrix Decomposition and its Modern Applications: A Rigorous First Course

Matrix decomposition has become a core technology in machine learning, l...

On the Column and Row Ranks of a Matrix

Every m by n matrix A with rank r has exactly r independent rows and r i...

Revisit the Fundamental Theorem of Linear Algebra

This survey is meant to provide an introduction to the fundamental theor...

LDU factorization

LU-factorization of matrices is one of the fundamental algorithms of lin...

numpywren: serverless linear algebra

Linear algebra operations are widely used in scientific computing and ma...

Predicting the Integer Decomposition Property via Machine Learning

In this paper we investigate the ability of a neural network to approxim...

Super-linear convergence in the p-adic QR-algorithm

The QR-algorithm is one of the most important algorithms in linear algeb...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.