Title: Feature weighting for naïve Bayes using multi objective artificial bee colony algorithm

Authors: Abhilasha Chaudhuri; Tirath Prasad Sahu

Addresses: Department of Information Technology, National Institute of Technology Raipur, Chhattisgarh, India ' Department of Information Technology, National Institute of Technology Raipur, Chhattisgarh, India

Abstract: Naïve Bayes (NB) is a widely used classifier in the field of machine learning. However, its conditional independence assumption does not hold true in real-world applications. In literature, various feature weighting approaches have attempted to alleviate this assumption. Almost all of these approaches consider the relationship between feature-class (relevancy) and feature-feature (redundancy) independently, to determine the weights of features. We argue that these two relationships are mutually dependent and both cannot be improved simultaneously, i.e., form a trade-off. This paper proposes a new paradigm to determine the feature weight by formulating it as a multi-objective optimisation problem to balance the trade-off between relevancy and redundancy. Multi-objective artificial bee colony-based feature weighting technique for naïve Bayes (MOABC-FWNB) is proposed. An extensive experimental study was conducted on 20 benchmark UCI datasets. Experimental results show that MOABC-FWNB outperforms NB and other existing state-of-the-art feature weighting techniques.

Keywords: naïve Bayes; feature weighting; multi objective optimisation; artificial bee colony.

DOI: 10.1504/IJCSE.2021.113655

International Journal of Computational Science and Engineering, 2021 Vol.24 No.1, pp.74 - 88

Received: 23 May 2020
Accepted: 23 Aug 2020
Published online: 15 Mar 2021 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article