Title: A novel performance aware real-time data handling for big data platforms on Lambda architecture

Authors: Rizwan Patan; M. Rajasekhara Babu

Addresses: School of Computer Science and Engineering, VIT University, Vellore-632015, Tamil Nadu, India ' School of Computer Science and Engineering, VIT University, Vellore-632015, Tamil Nadu, India

Abstract: Big data is becoming a popular technology for analytics. But, its techniques and tools are very limited to solve the energy aware real time data handling problems. The real time data handling can be in one of the two computing areas: 1) batch computing; 2) stream computing. Stream computing environment uses round robin algorithm as default scheduling strategy whereas batch process uses distributed scheduling for allocation of its resources. But these computing are not considered proper energy aware distributed scheduling policies for allocation of its resources. This paper presents development of management policies that reduces the energy for the allocation of resources. The big data fusion has been used to improve the efficiency for handing different data types: Batch data, online data, and real-time data. A hybrid computational model has been applied to improve the performance further through Lambda architecture. Finally, experimental results have shown 20% performance improvement.

Keywords: big data; batch computing; energy efficiency; stream computing; response time; resource scheduling.

DOI: 10.1504/IJCAET.2018.092840

International Journal of Computer Aided Engineering and Technology, 2018 Vol.10 No.4, pp.418 - 430

Received: 16 Jun 2016
Accepted: 12 Jul 2016
Published online: 01 Jul 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article