Variance and density-based anomaly identification and ranking for evolving data streams
by Yogita; Durga Toshniwal
International Journal of Computational Intelligence Studies (IJCISTUDIES), Vol. 3, No. 2/3, 2014

Abstract: Data stream mining is emerging as an important research area in the recent times. This is due the fact that streaming data gets generated from many applications. Stream mining is very challenging because streaming data cannot be scanned multiple times and also new concepts may keep evolving in the data. Finding anomalies from data streams is of great significance in many applications. Most of the existing anomaly detection techniques suffer from many limitations. They are commonly applicable to static data of uniform densities. But the majority of real world data is of varying densities. In the present work, we propose a method which identifies anomalies based on variance and data density and also assigns ranks to anomalies. Initially, variance-based clustering is done to find the candidate anomalies. After finding the candidate anomalies, we assign ranks to them based on the densities of the clusters. Furthermore, to reduce the effect of irrelevant (noisy) attributes during anomaly detection, the proposed method assigns weights to attributes depending upon their respective relevance. Keeping in view the challenges of streaming data, the proposed method is incremental and adaptive to evolution of new concept in the data. Experimental results on both synthetic and real world datasets show that the proposed method outperforms other existing methods.

Online publication date: Sat, 28-Jun-2014

The full text of this article is only available to individual subscribers or to users at subscribing institutions.

 
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.

Pay per view:
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.

Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Computational Intelligence Studies (IJCISTUDIES):
Login with your Inderscience username and password:

Username:        Password:          Forgotten your password?

Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.

If you still need assistance, please email subs@inderscience.com