The Singular Value Decomposition in Multivariate Statistics

Hammarling, Sven (1985) The Singular Value Decomposition in Multivariate Statistics. ACM Signum Newsletter, 20 (3). pp. 2-25.

PDF SVD-Signum85.pdf Download (1MB)

Abstract

Many multivariate techniques in statistics are described in terms of an appropriate sums of squares and cross products matrix, such as a covariance matrix, or a correlation matrix, rather than in terms of the original data matrix. While this is frequently the best way of understanding and analysing a technique, it is not necessarily the most satisfactory approach for implementing the technique computationally. From a numerical point of view, it is usually better to work with the data matrix. This is a review article aimed at the statistician and mathematician who, while not being expert numerical analysts, would like to gain some understanding of why it is better to work with the data matrix, and of the techniques that allow us to avoid the explicit computation of sums and squares and cross products matrices. To give a focus and to keep the article of moderate length, we concentrate in particular on the use of the singular value decomposition and its application to multiple regression problems. In the final two sections we give a brief discussion of principal components, canonical correlations and the generalized singular value decomposition.

Item Type:	Article
Uncontrolled Keywords:	Singular value decomposition; multivariate statistics; numerical stability
Subjects:	MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theory MSC 2010, the AMS's Mathematics Subject Classification > 62 Statistics MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis
Depositing User:	Sven Hammarling
Date Deposited:	01 Jul 2008
Last Modified:	20 Oct 2017 14:12
URI:	https://eprints.maths.manchester.ac.uk/id/eprint/1121

Actions (login required)

View Item