Title: Tuning parameters via a new rapid, accurate and parameter-less method using meta-learning

Authors: Alireza Hekmatinia; Ali Mohammadi Shanghooshabad; Mohammad Mahdi Motevali; Mehrdad Almasi

Addresses: Faculty of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran ' Faculty of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran ' Computer Engineering Department, Semnan Branch, Islamic Azad University, Semnan, Iran ' Faculty of Electrical and Computer Engineering, Tarbiat Modares University, Tehran, Iran

Abstract: Dealing with a large parameter space in data mining tasks is extremely time-consuming, and the tuning method itself needs to be tuned since methods themselves have at least one parameter. Here, a new rapid and parameter-less method is presented to tune algorithms on diverse datasets to achieve high quality results in a short consumed time. The method presented here uses a pre-knowledge by using meta-features to guess closer point to optimal point in parameter space of target algorithms (here, support vector machine algorithm is used). For preparing the pre-knowledge, 282 meta-features are introduced and then genetic algorithm is applied to determine best meta-features for the target algorithm. Then the best meta-features are used to tune the target algorithm on unseen datasets. The results show in less than 0.19 minute in average, the method obtains approximately the same classification rates in comparison with others, but the consumed time is dramatically declined.

Keywords: parameter tuning; meta learning; meta feature; SVM tuning; genetic algorithm.

DOI: 10.1504/IJDMMM.2019.102727

International Journal of Data Mining, Modelling and Management, 2019 Vol.11 No.4, pp.366 - 390

Accepted: 08 Oct 2018
Published online: 02 Oct 2019 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article