Title: Scalable loop self-scheduling schemes for heterogeneous clusters

Authors: Anthony T. Chronopoulos, Satish Penmatsa, Ning Yu, Du Yu

Addresses: Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA. ' Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA. ' Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA. ' Department of Computer Science, The University of Texas, 6900 N Loop, 1604 W, San Antonio, TX 78249, USA

Abstract: Heterogeneous cluster systems (e.g., a LAN of computers) can be used for concurrent processing for some applications. However, a serious difficulty in concurrent programming of a heterogeneous system is how to deal with scheduling and load balancing of such a system that may consist of heterogeneous computers. Distributed scheduling schemes suitable for parallel loops with independent iterations on heterogeneous computer clusters have been proposed and analysed in the past. Here, we implement the previous schemes in MPI. We present an extension of these schemes implemented in a hierarchical Master–Slave architecture and include experimental results and comparisons.

Keywords: scalable self-scheduling; distributed scheduling; parallel loops; scheduling schemes; heterogeneous clusters; LANs; concurrent programming; parallel computing; load balancing.

DOI: 10.1504/IJCSE.2005.009696

International Journal of Computational Science and Engineering, 2005 Vol.1 No.2/3/4, pp.110 - 117

Available online: 05 May 2006 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article