Row-wise backward stable elimination methods for the equality constrained least squares problem

Cox, Anthony J. and Higham, Nicholas J. (1999) Row-wise backward stable elimination methods for the equality constrained least squares problem. SIAM Journal On Matrix Analysis And Applications, 21 (1). pp. 313-326. ISSN 1095-7162

PDF 33595.pdf Download (324kB)

Abstract

It is well known that the solution of the equality constrained least squares (LSE) problem min Bx=d ||b-Ax||2 is the limit of the solution of the unconstrained weighted least squares problem $$ \min_x\left\| \bmatrix{ \mu d \cr b } - \bmatrix{\mu B \cr A } x \right\|_2 $$ as the weight $\mu$ tends to infinity, assuming that $\bmatrix{B^T & A^T \cr}^T$ has full rank. We derive a method for the LSE problem by applying Householder QR factorization with column pivoting to this weighted problem and taking the limit analytically, with an appropriate rescaling of rows. The method obtained is a type of direct elimination method. We adapt existing error analysis for the unconstrained problem to obtain a row-wise backward error bound for the method. The bound shows that, provided row pivoting or row sorting is used, the method is well-suited to problems in which the rows of A and B vary widely in norm. As a by-product of our analysis, we derive a row-wise backward error bound of precisely the same form for the standard elimination method for solving the LSE problem. We illustrate our results with numerical tests.

Item Type:	Article
Uncontrolled Keywords:	constrained least squares problem, column pivoting, weighted least squares problem, Householder QR factorization, Gaussian elimination, elimination method, rounding error analysis, backward stability, row pivoting, row sorting
Subjects:	MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theory MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis
Depositing User:	Ms Lucy van Russelt
Date Deposited:	03 Jul 2006
Last Modified:	20 Oct 2017 14:12
URI:	https://eprints.maths.manchester.ac.uk/id/eprint/353

Actions (login required)

View Item