Title: Application of microblog big data based for web-based communities

Authors: Weilong Zhang; Tao Yu

Addresses: Quality Management Center, Hebei Jiaotong Vocational and Technical College, Shijiazhuang, Hebei 050035, China ' Hebei Vocational College of Labour Relations, No. 6, College Road, South End of Hongqi Street, Shijiazhuang, Hebei 050002, China

Abstract: Microblog is a new forum to publish short text. Because of its huge user base and its convenience, it promises to be an excellent instrumentation for feeding and sustaining web-based communities. Therefore, the analysis of microblog topics is introduced and proposed as reference for correct decision making in online communities. This paper briefly introduces the collection method of microblog data and the clustering algorithm of topic classification. Then the clustering algorithm is improved, and the Storm system was introduced. The K-means algorithm before and after the improvement was simulated and analysed in the single-machine environment and Storm framework. The results show that the improved clustering algorithm has a higher classification accuracy and a lower false alarm rate both in the single-machine environment and Storm framework. Under the same clustering algorithm, the algorithm in the Storm framework has a higher classification accuracy, a lower false alarm rate and a shorter recognition time.

Keywords: web-based communities; Storm; microblog; clustering algorithm; latent Dirichlet allocation.

DOI: 10.1504/IJWBC.2021.114451

International Journal of Web Based Communities, 2021 Vol.17 No.2, pp.77 - 87

Received: 07 Feb 2020
Accepted: 06 Apr 2020
Published online: 22 Apr 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article