Title: Dynamic workflow scheduling in the cloud using a neural network-based multi-objective evolutionary algorithm

Authors: K. Jairam Naik; Siddharth Chandra; Paras Agarwal

Addresses: Department of Computer Science and Engineering, National Institute of Technology Raipur, Raipur (C.G)-492010, India ' Department of Computer Science and Engineering, National Institute of Technology Raipur, Raipur (C.G)-492010, India ' Department of Computer Science and Engineering, National Institute of Technology Raipur, Raipur (C.G)-492010, India

Abstract: Workflow is a series of jobs that are executed in order to complete a specific activity where the jobs are often dependent on each other. Data transfer that might occur between such jobs results into the creation of a workflow that aims at utilising resources for workflow tasks by optimising the use of cloud resources. Few of the existing single objectives workflows scheduling solutions have linearly combine multiple objectives to get a multi-objective solution, but it might not be able to model the real-world problem efficiently for certain conditions where the environment is dynamic in nature. Hence, a Neural Network based Multi-Objective Evolutionary Algorithm (NN-MOHEFT) that solves the multi-objective workflow scheduling issues in a dynamic environment was proposed in this article. The NN-MOHEFT learns the pattern behind changing Pareto optimal front for successive environment and tries to predict the Pareto optimal front for the next environment from the input Pareto optimal set of the current environment. The proposed NN-MOHEFT algorithm is at par with the original constructs when it comes to the hypervolume of objectives generated. It generates 10% more non-dominated solutions as compared to the original construct.

Keywords: workflow scheduling; cloud computing; resources; multi-objective; makespan; utilisation; hypervolume; EC2 instances.

DOI: 10.1504/IJCNDS.2021.119210

International Journal of Communication Networks and Distributed Systems, 2021 Vol.27 No.4, pp.424 - 451

Received: 26 Mar 2021
Accepted: 15 Apr 2021
Published online: 29 Nov 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article