Title: Joint optimisation of feature selection and SVM parameters based on an improved fireworks algorithm

Authors: Xiaoning Shen; Jiyong Xu; Mingjian Mao; Jiaqi Lu; Liyan Song; Qian Wang

Addresses: B-DAT, CICAEET, School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China ' B-DAT, CICAEET, School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China ' B-DAT, CICAEET, School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China ' B-DAT, CICAEET, School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China ' Guangdong Provincial Key Laboratory of Brain-inspired Intelligent Computation, Southern University of Science and Technology, Shenzhen 518055, China ' B-DAT, CICAEET, School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, China

Abstract: In order to reduce the redundant features and improve the accuracy in classification, an improved fireworks algorithm for joint optimisation of feature selection and SVM parameters is proposed. A new fitness evaluation method is designed, which can adjust the punishment degree adaptively with the increase of the number of selected features. A differential mutation operator is introduced to enhance the information interaction among fireworks and improve the local search ability of the fireworks algorithm. A fitness-based roulette wheel selection strategy is proposed to reduce the computational complexity of the selection operator. Three groups of comparisons on 14 UCI classification datasets with increasing scales validate the effectiveness of our strategies and the significance of joint optimisation. Experimental results show that the proposed algorithm can obtain a higher accuracy in classification with fewer features.

Keywords: fireworks algorithm; support vector machines; feature selection; parameter optimisation; joint optimisation.

DOI: 10.1504/IJCSE.2023.135280

International Journal of Computational Science and Engineering, 2023 Vol.26 No.6, pp.702 - 714

Received: 10 Apr 2022
Received in revised form: 08 Jul 2022
Accepted: 11 Jul 2022
Published online: 04 Dec 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article