Croci, Matteo and Fasi, Massimiliano and Higham, Nicholas J. and Mary, Theo and Mikaitis, Mantas (2021) Stochastic Rounding: Implementation, Error Analysis, and Applications. [MIMS Preprint]
![[thumbnail of cfhm21.pdf]](https://eprints.maths.manchester.ac.uk/style/images/fileicons/text.png) |
Text
cfhm21.pdf Download (497kB) |
Abstract
Stochastic rounding randomly maps a real number to one of the two nearest values in a finite precision number system. First proposed for use in computer arithmetic in the 1950s, it is attracting renewed interest. If used in floating-point arithmetic in the computation of the inner product of two vectors of length n, it yields an error bounded by \sqrt(n)u with high probability, where u is the unit roundoff, which is not necessarily the case for round to nearest. A particular attraction of stochastic rounding is that, unlike round to nearest, it is immune to the phenomenon of stagnation, whereby a sequence of tiny updates to a relatively large quantity are lost. We survey stochastic rounding, covering its mathematical properties and probabilistic error analysis, its implementation, and its use in applications, including deep learning and the numerical solution of differential equations.
| Item Type: | MIMS Preprint |
|---|---|
| Subjects: | MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis MSC 2010, the AMS's Mathematics Subject Classification > 68 Computer science |
| Depositing User: | Mr Mantas Mikaitis |
| Date Deposited: | 14 Oct 2021 09:36 |
| Last Modified: | 14 Oct 2021 09:36 |
| URI: | https://eprints.maths.manchester.ac.uk/id/eprint/2836 |
Available Versions of this Item
- Stochastic Rounding: Implementation, Error Analysis, and Applications. (deposited 14 Oct 2021 09:36) [Currently Displayed]
Actions (login required)
 |
View Item |