Title: SPHINX: a scheduling middleware for data intensive applications on a grid

Authors: Jang-uk In; Jong Hyuk Park

Addresses: SQL Engine Platform, Microsoft Corporation, One Microsoft Way, Redmond, WA 98052-7329, USA. ' Department of Computer Science and Engineering, Seoul National University of Science and Technology (SeoulTech), 172 Gongreung 2-dong, Nowon-gu, Seoul, 139-743, Korea

Abstract: A grid consists of high-end computational, storage, and network resources that, while known a priori, are dynamic with respect to activity and availability. Efficient scheduling of requests to use grid resources must adapt to this dynamic environment while meeting administrative policies. This paper discusses the necessary requirements of such a scheduler and proposes a framework called SPHINX that can administrate grid policies and schedule complex and data intensive scientific applications. The SPHINX design allows for a number of functional modules to flexibly plan and schedule workflows representing multiple applications on the grids. It also allows for performance evaluation of multiple algorithms for each functional module. We present early experimental results for SPHINX that effectively utilises other grid infrastructures such as workflow management systems and execution systems. These results demonstrate that SPHINX can effectively schedule work across a large number of distributed clusters that are owned by multiple units in a virtual organisation.

Keywords: grid computing; middleware; quality of service; QoS; scheduling; data intensive applications; performance evaluation.

DOI: 10.1504/IJIPT.2011.043677

International Journal of Internet Protocol Technology, 2011 Vol.6 No.3, pp.184 - 194

Published online: 21 Mar 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article