Title: SPGM: an efficient algorithm for mapping MapReduce-like data-intensive applications in data centre network

Authors: Xiaoling Li; Huaimin Wang; Bo Ding; Xiaoyong Li

Addresses: National Key Laboratory for Parallel and Distributed Processing, School of Computer Science, National University of Defense Technology, Changsha 410073, China ' National Key Laboratory for Parallel and Distributed Processing, School of Computer Science, National University of Defense Technology, Changsha 410073, China ' National Key Laboratory for Parallel and Distributed Processing, School of Computer Science, National University of Defense Technology, Changsha 410073, China ' National Key Laboratory for Parallel and Distributed Processing, School of Computer Science, National University of Defense Technology, Changsha 410073, China

Abstract: In traditional data centre network, how to efficiently allocate the virtual data centres (VDCs) on the physical data centre network (PDCN) is a challenging problem, which is denoted as GraphMap. GraphMap refers to map the virtual nodes to the substrate nodes and the virtual links to the substrate paths, respectively. The existing heuristic approaches attempt a two stage solution by solving the node mapping in a first stage and doing the link mapping in a second stage, which results in the mapping time being very large. In this paper, we propose an efficient mapping algorithm based on shortest path graph matching (SPGM) for online MapReduce-like data-intensive applications; the simulations show that SPGM can efficiently allocate the MapReduce-like data intensive applications on the PDCN in a much shorter time compared to the existing heuristic algorithms and maintain good performance.

Keywords: data centre networks; virtual data centres; physical data centre networks; MapReduce-like; data intensive applications; mapping algorithms; shortest path graph matching; SPGM; simulation.

DOI: 10.1504/IJWGS.2013.054112

International Journal of Web and Grid Services, 2013 Vol.9 No.2, pp.172 - 192

Received: 26 Dec 2012
Accepted: 01 Feb 2013
Published online: 29 Sep 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article