Random Matrices Generating Large Growth in LU Factorization with Pivoting

Higham, Desmond J. and Higham, Nicholas J. and Pranesh, Srikara (2020) Random Matrices Generating Large Growth in LU Factorization with Pivoting. [MIMS Preprint]

This is the latest version of this item.

[thumbnail of paper.pdf] Text
paper.pdf
Download (435kB)

Abstract

We identify a class of random, dense $n\times n$ matrices for which LU factorization with any form of pivoting produces a growth factor typically of size at least $n/(4 \log n)$ for large $n$. The condition number of the matrices can be arbitrarily chosen and large growth also happens for the transpose. No previous matrices with all these properties were known. The matrices can be generated by the MATLAB function \verb"gallery('randsvd',..)", and they are formed as the product of two random orthogonal matrices from the Haar distribution with a diagonal matrix having only one diagonal entry different from $1$, which lies between $0$ and $1$ (the ``one small singular value'' case). Our explanation for the large growth uses the fact that the maximum absolute value of any element of a Haar distributed orthogonal matrix tends to be relatively small for large $n$. We verify the behavior numerically, finding that for partial pivoting the actual growth is significantly larger than the lower bound, and much larger than the growth observed for random matrices with elements from the uniform $[0,1$] or standard normal distributions. We show more generally that a rank-$1$ perturbation to an orthogonal matrix producing large growth for any form of pivoting also generates large growth under reasonable assumptions. Finally, we demonstrate that GMRES-based iterative refinement can provide stable solutions to $Ax = b$ when large growth occurs in low precision LU factors, even when standard iterative refinement cannot.

Item Type: MIMS Preprint
Uncontrolled Keywords: LU factorization, Gaussian elimination, large growth factor, pivoting, random orthogonal matrix, Haar distribution, MATLAB, randsvd, GMRES-based iterative refinement
Subjects: MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theory
MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis
Depositing User: Nick Higham
Date Deposited: 30 Oct 2020 12:11
Last Modified: 30 Oct 2020 12:11
URI: https://eprints.maths.manchester.ac.uk/id/eprint/2789

Available Versions of this Item

Actions (login required)

View Item View Item