Department of Electrical Engineering and Computer Science

Technical Reports

“Heterogenous Acceleration for Linear Algebra in Mulit-Coprocessor Environments”

Azzam Haidar and Piotr Luszczek and Stanimire Tomov and Jack Dongarra

Published  February 14, 2014  as  ut-eecs-14-724

We present an ecient and scalable programming model for the development of linear algebra in heterogeneous multi-coprocessor environments. The model incorporates some of the current best design and implementation practices for the heterogeneous acceleration of dense linear algebra (DLA). Examples are given as the basis for solving linear systems' algorithms { the LU, QR, and Cholesky factorizations. To generate the extreme level of parallelism needed for the ecient use of coprocessors, algorithms of interest are redesigned and then split into well-chosen computational tasks. The tasks execution is scheduled over the computational components of a hybrid system of multi-core CPUs and coprocessors using a light-weight runtime system. The use of light-weight runtime systems keeps scheduling overhead low, while enabling the expression of parallelism through otherwise sequential code. This simpli es the development eorts and allows the exploration of the unique strengths of the various hardware components.


« Back to Listing



The University of Tennessee, Knoxville. Big Orange. Big Ideas.

Knoxville, Tennessee 37996 | 865-974-1000
The flagship campus of the University of Tennessee System