Title: A dataflow optimisation mechanism for service-oriented cloud workflow

Authors: Peng Zhang; Yanbo Han; Muhammad Ali Babar

Addresses: North China University of Technology, 100041, China; Institute of Information Engineering, CAS, 100093, China ' North China University of Technology, 100041, China ' IT University of Copenhagen, DK-2300, Copenhagen, Denmark

Abstract: While service-oriented cloud workflow shows potentials of inherent scalability, loose coupling and expenditure reduction, such issues as data transfer and efficiency have popped up as major concerns. In this paper, a dataflow optimisation mechanism is proposed, including data transfer strategy and data placement strategy. The data transfer strategy uses integrated data structures to enable the elimination of the SOAP serialisation and de-serialisation within the web service invocation by the exchange of their references. In addition, the data placement strategy groups the existing datasets and dynamically clusters newly generated datasets to minimise data transfers while keeping a polynomial time complexity. By integrating the optimisation mechanism into service-oriented cloud workflow system, we can expect efficiency improvements in data transfer and workflow execution. Experiments and analysis supported our efforts.

Keywords: service-oriented cloud workflow; data transfer; data placement; data affinity matrix; integrated data structure; dataflow optimisation; service-oriented architecture; SOA; cloud computing; workflow execution.

DOI: 10.1504/IJCSE.2015.067053

International Journal of Computational Science and Engineering, 2015 Vol.10 No.1/2, pp.15 - 31

Received: 18 Jul 2012
Accepted: 06 Nov 2012

Published online: 25 Jan 2015 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article