Computing the Fréchet Derivative of the Matrix Exponential, with an application to Condition Number Estimation

Al-Mohy, Awad H. and Higham, Nicholas J. (2009) Computing the Fréchet Derivative of the Matrix Exponential, with an application to Condition Number Estimation. SIAM Journal On Matrix Analysis and Applications., 30 (4). pp. 1639-1657. ISSN 1095-7162

PDF alhi09.pdf Download (338kB)

Abstract

The matrix exponential is a much-studied matrix function having many applications. The Fr\'echet derivative of the matrix exponential describes the first order sensitivity of $e^A$ to perturbations in $A$ and its norm determines a condition number for $e^A$. Among the numerous methods for computing $e^A$ the scaling and squaring method is the most widely used. We show that the implementation of the method in [N.~J. Higham. The scaling and squaring method for the matrix exponential revisited. {\em SIAM J. Matrix Anal. Appl.}, 26(4):1179--1193, 2005] can be extended to compute both $e^A$ and the Fr\'echet derivative at $A$ in the direction $E$, denoted by $L(A,E)$, at a cost about three times that for computing $e^A$ alone. The algorithm is derived from the scaling and squaring method by differentiating the Pad\'e approximants and the squaring recurrence, re-using quantities computed during the evaluation of the Pad\'e approximant, and intertwining the recurrences in the squaring phase. To guide the choice of algorithmic parameters an extension of the existing backward error analysis for the scaling and squaring method is developed which shows that, modulo rounding errors, the approximations obtained are $e^{A+\Delta A}$ and $L(A+\Delta A, E + \Delta E)$, with the same $\Delta A$ in both cases, and with computable bounds on $\|\Delta A\|$ and $\|\Delta E\|$. The algorithm for $L(A,E)$ is used to develop an algorithm that computes $e^A$ together with an estimate of its condition number. In addition to results specific to the exponential, we develop some results and techniques for arbitrary functions. We show how a matrix iteration for $f(A)$ yields an iteration for the Fr\'echet derivative and show how to efficiently compute the Fr\'echet derivative of a power series. We also show that a matrix polynomial and its Fr\'echet derivative can be evaluated at a cost at most three times that of computing the polynomial itself and give a general framework for evaluating a matrix function and its Fr\'echet derivative via Pad\'e approximation.

Item Type:	Article
Uncontrolled Keywords:	matrix function, Fr\'echet derivative, matrix polynomial, matrix iteration, matrix exponential, condition number estimation, scaling and squaring method, Pad\'e approximation, backward error analysis
Subjects:	MSC 2010, the AMS's Mathematics Subject Classification > 15 Linear and multilinear algebra; matrix theory MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis
Depositing User:	Nick Higham
Date Deposited:	29 Jan 2009
Last Modified:	20 Oct 2017 14:12
URI:	https://eprints.maths.manchester.ac.uk/id/eprint/1218

Actions (login required)

View Item