Title: Analysis of feature selection measures for text categorisation

Authors: V. Mary Amala Bai; D. Manimegalai

Addresses: Department of Information Technology, Noorul Islam University, Tamil Nadu, 629180, India ' Department of Information Technology, National Engineering College, Tamil Nadu, 628503, India

Abstract: The curse of dimensionality has made dimension reduction an essential step in text categorisation. Feature selection is an approach for dimension reduction. In this paper an analysis on feature selection measures for text categorisation is performed. Under the unsupervised approach document frequency and under the supervised approach chi-square, odds ratio, mutual information, and information gain are considered for analysis. They are considered here because they are the widely used and effective measures. Analysis of these measures is performed using the 20 newsgroups dataset. Twenty newsgroups dataset consists of closely related categories as well as highly unrelated categories. Certain categories of 20 newsgroups dataset are selected and organised into three groups of overlapping (highly related) classes, non-overlapping (highly unrelated) classes and combination of overlapping and non-overlapping classes. Feature selection and subsequent classification is applied to the three groups separately and the classification performance is studied based on the feature selection measures. The noticeable behaviour was with odds ratio measure in that it performed well for non-overlapping group and overlapping groups considered separately and was poorer in performance for the group containing both overlapping and non-overlapping categories. Remaining measures showed consistent behaviour for all the three groups. Classification was achieved using support vector machine classifier. The performance comparisons of different measures on different groups are presented in terms of micro-F₁ and macro-F₁.

Keywords: text categorisation; feature selection; supervised approach; unsupervised approach; support vector machine classifier.

DOI: 10.1504/IJENM.2017.083606

International Journal of Enterprise Network Management, 2017 Vol.8 No.1, pp.45 - 60

Received: 13 Dec 2014
Accepted: 02 Jul 2015
Published online: 12 Apr 2017 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article