Performance Analysis of Asynchronous Parallel Jacobi

Hook, James and Dingle, Nick (2013) Performance Analysis of Asynchronous Parallel Jacobi. [MIMS Preprint]

[thumbnail of paper.pdf] PDF
paper.pdf

Download (518kB)

Abstract

The directed acyclic graph (DAG) associated with a parallel al- gorithm captures the order in which separate local computations are completed and how their outputs are subsequently used in further com- putations. Unlike in a synchronous parallel algorithm the DAG asso- ciated with an asynchronous parallel algorithm is not predetermined. Instead it is a product of the asynchronous timing dynamics of the machine and, as such, it is best thought of as a pseudorandom vari- able. In this paper we present a new tighter bound on the rate of convergence of asynchronous parallel Jacobi (APJ), which is based on statistical properties of the DAG and is valid for systems which satisfy a standard sufficient condition for convergence. We also describe an experiment in which we make a precise log of the calculations taking place during an implementation of APJ on a distributed memory multicore machine, which enables us to reconstruct and study the DAG. We demonstrate that our bound provides a good approximation of the true rate of convergence in these examples and show how problems in the algorithm�s implementation can affect the asynchronous timing dynamics and in turn the rate of convergence of the algorithm.

Item Type: MIMS Preprint
Uncontrolled Keywords: Asynchronous parallel Jacobi, chaotic iterations, parallel algorithm performance
Subjects: MSC 2010, the AMS's Mathematics Subject Classification > 37 Dynamical systems and ergodic theory
MSC 2010, the AMS's Mathematics Subject Classification > 60 Probability theory and stochastic processes
MSC 2010, the AMS's Mathematics Subject Classification > 65 Numerical analysis
MSC 2010, the AMS's Mathematics Subject Classification > 68 Computer science
Depositing User: Mr James Hook
Date Deposited: 29 Oct 2013
Last Modified: 08 Nov 2017 18:18
URI: https://eprints.maths.manchester.ac.uk/id/eprint/2036

Actions (login required)

View Item View Item