Detection of stragglers and optimal rescheduling of slow running tasks in big data environment using LFCSO-LVQ classifier and enhanced PSO algorithm
by Hetal A. Joshiara; Chirag S. Thaker; Sanjay M. Shah; Darshan B. Choksi
International Journal of Data Analysis Techniques and Strategies (IJDATS), Vol. 14, No. 1, 2022

Abstract: This paper plans to implement intelligent techniques in finding straggler tasks along with speculating their way of execution. Here, the LFCSO-LVQ is proposed to effectively identify the slow running tasks as of a bunch of user tasks, and the enhanced PSO is proposed for performing optimal rescheduling of the identified SR tasks. Initially, the collected data are preprocessed by means of identifying homogenous and heterogeneous tasks. After that, the Apache Spark split the preprocessed tasks into several sub-tasks. The features are extracted as of these subtasks for SR task prediction. An information gain-based linear discriminant analysis is proposed for feature selection approach that reduces the classifier's training time. Subsequent to FS, the selected ones are inputted to LFCSO-LVQ, which envisages the SR tasks of the dataset centred on the chosen features. After that, EPSO reschedules these predicted tasks to the other fastest nodes of virtual machine.

Online publication date: Wed, 16-Mar-2022

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Data Analysis Techniques and Strategies (IJDATS):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com