Title: Distributed predictive performance anomaly detection for virtualised platforms
Authors: Ali Imran Jehangiri; Ramin Yahyapour; Edwin Yaqub; Philipp Wieder
Addresses: Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany ' Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen (GWDG), Göttingen, Germany
Abstract: Predicting subsequent values of quality of service (QoS) properties is a key component of autonomic solutions. Predictions help in the management of cloud-based applications by preventing QoS breaches from happening. The huge amount of monitoring data generated by cloud platforms motivated the applicability of scalable data mining and machine learning techniques for predicting performance anomalies. Building prediction models individually for thousands of virtual machines (VMs) requires a robust generic methodology with minimal human intervention. In this work, we focus on these issues and present three main contributions. First, we compare several time series modelling approaches to evidence the predictive capabilities of these approaches. Second, we propose estimation-classification models that augment the predictive capabilities of machine learning classification methods (random forest, decision tree, and support vector machine) by combining them with time series analysis methods (AR, ARIMA and ETS). Third, we show how the data mining techniques in conjunction with Hadoop framework can be a useful, practical, and inexpensive method for predicting QoS attributes.
Keywords: cloud; performance prediction; monitoring; quality of service; QoS; analytics; distributed time-series database.
DOI: 10.1504/IJHPCN.2018.093229
International Journal of High Performance Computing and Networking, 2018 Vol.11 No.4, pp.279 - 290
Received: 31 Jul 2015
Accepted: 20 Feb 2016
Published online: 24 Jul 2018 *