Int. J. of Business Intelligence and Data Mining   »   2018 Vol.13, No.1/2/3

 

 

Title: Detecting and ranking events in Twitter using diversity analysis

 

Author: Daoud M. Daoud

 

Address: Department of Software Engineering, Princess Sumaya University for Technology, Amman, Jordan

 

Abstract: In Twitter and in other social media channels, detecting events is very important and has many applications. However, this task is very challenging because of the huge number of tweets that are posted every minute and the massive scale of the spamming activities. In this paper, we present an innovative approach for detecting events using data posted to Twitter. The proposed approach is based on the concept of user's attention by quantitatively modelling the diversity of hashtags using Shannon's index. Our method records the diversity values on an hourly basis time-series. Using statistical techniques, the method locates the intervals having diversity values that fall outside the range of forecasted ones (normal state). We also present the labelling and ranking techniques that are implemented in this research. Experimental results on a dataset consisting of 15 million Arabic tweets show that our proposed approach can effectively detect real-world events in Twitter.

 

Keywords: social media; event detection; diversity index; Twitter; Arabic; hashtags; time-series analysis; z-score; events labelling; events ranking.

 

DOI: 10.1504/IJBIDM.2017.10003611

 

Int. J. of Business Intelligence and Data Mining, 2018 Vol.13, No.1/2/3, pp.129 - 146

 

Available online: 03 Nov 2017

 

 

Editors Full text accessAccess for SubscribersPurchase this articleComment on this article