# Accelerating the Solution of Linear Systems by Iterative Refinement in Three Precisions

Carson, Erin and Higham, Nicholas J. (2017) Accelerating the Solution of Linear Systems by Iterative Refinement in Three Precisions. [MIMS Preprint]

 There is a more recent version of this item available.
 PDF paper.pdf Download (933kB)

## Abstract

We propose a general algorithm for solving a $n\times n$ nonsingular linear system $Ax = b$ based on iterative refinement with three precisions. The working precision is combined with possibly different precisions for solving for the correction term and for computing the residuals. Via rounding error analysis of the algorithm we derive sufficient conditions for convergence and bounds for the attainable normwise forward error and normwise and componentwise backward errors. Our results generalize and unify many existing rounding error analyses for iterative refinement. With single precision as the working precision, we show that by using LU factorization in IEEE half precision as the solver and calculating the residuals in double precision it is possible to solve $Ax = b$ to full single precision accuracy for condition numbers $\kappa_2(A) \le 10^4$, with the $O(n^3)$ part of the computations carried out entirely in half precision. We show further that by solving the correction equations by GMRES preconditioned by the LU factors the restriction on the condition number can be weakened to $\kappa_2(A) \le 10^8$, although in general there is no guarantee that GMRES will converge quickly. Taking for comparison a standard $Ax = b$ solver that uses LU factorization in single precision, these results suggest that on architectures for which half precision is efficiently implemented it will be possible to solve certain linear systems $Ax = b$ up to twice as fast \emph{and} to greater accuracy. Analogous results are given with double precision as the working precision.

Item Type: MIMS Preprint iterative refinement, linear system, multiple precision, mixed precision, rounding error analysis, backward error, forward error, GMRES, preconditioning MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theoryMSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis Nick Higham 26 Jul 2017 08 Nov 2017 18:18 http://eprints.maths.manchester.ac.uk/id/eprint/2562

### Actions (login required)

 View Item