Title: Distributed predictive performance anomaly detection for virtualised platforms

Authors: Ali Imran Jehangiri; Ramin Yahyapour; Edwin Yaqub; Philipp Wieder

Addresses: Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany

Abstract: Predicting subsequent values of quality of service (QoS) properties is a key component of autonomic solutions. Predictions help in the management of cloud-based applications by preventing QoS breaches from happening. The huge amount of monitoring data generated by cloud platforms motivated the applicability of scalable data mining and machine learning techniques for predicting performance anomalies. Building prediction models individually for thousands of virtual machines (VMs) requires a robust generic methodology with minimal human intervention. In this work, we focus on these issues and present three main contributions. First, we compare several time series modelling approaches to evidence the predictive capabilities of these approaches. Second, we propose estimation-classification models that augment the predictive capabilities of machine learning classification methods (random forest, decision tree, and support vector machine) by combining them with time series analysis methods (AR, ARIMA and ETS). Third, we show how the data mining techniques in conjunction with Hadoop framework can be a useful, practical, and inexpensive method for predicting QoS attributes.

Keywords: cloud; performance prediction; monitoring; quality of service; QoS; analytics; distributed time-series database.

DOI: 10.1504/IJHPCN.2018.093229

International Journal of High Performance Computing and Networking, 2018 Vol.11 No.4, pp.279 - 290

Received: 31 Jul 2015
Accepted: 20 Feb 2016

Published online: 24 Jul 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article