Title: Adaptive building of hybrid learning model for detecting and adapting concept drifting data streams

Authors: Pramod D. Patil; Parag Kulkarni

Addresses: Department of Computer Engineering, Government College of Engineering, University of Pune, Pune, India ' Department of Computer Engineering, Government College of Engineering, University of Pune, Pune, India

Abstract: In recent developments in electricity market deregulation, the prices are not fixed. In such application, class labels are not available directly and potentially valuable information is lost. A learning model of electricity demand and prices needs to be adaptive for dynamic changes in massive data streams. This paper presents adaptive building of hybrid learning model for electricity prices by detecting and adapting concept drifting data streams. A proposed framework is build with four main challenges such as future assumption, change type, learner adaptivity and model. A decision tree is built incrementally using Q-learning and Hoeffding bounds. A k-mode method produces concept clusters to handle unlabelled data, change type in terms of deviations between past concept clusters and current ones and predicts future assumptions. An adaptive classify algorithm is developed for the predictive ability evaluation on the test set. Result of experiments using Elec2 data confirms applicability of methodology with more than 80% unlabelled data.

Keywords: adaptive learning models; decision tree; data streams; concept drift; reinforcement learning; electricity market deregulation; electricity prices; electricity demand; concept clusters.

DOI: 10.1504/IJKEDM.2014.066236

International Journal of Knowledge Engineering and Data Mining, 2014 Vol.3 No.1, pp.58 - 81

Accepted: 01 Sep 2014
Published online: 08 Dec 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article