Title: A case study on partitioning data for classification

Authors: Bikash Kanti Sarkar

Addresses: Department of Computer Science and Engineering, Birla Institute of Technology, Deemed University, Mesra, Ranchi, India

Abstract: Designing accurate model for classification problem is a real concern in context of machine learning. The various factors such as inclusion of excellent samples in the training set, the number of samples as well as the proportion of each class type in the set (that would be sufficient for designing model) play important roles in this purpose. In this article, an investigation is introduced to address the question of what proportion of the samples should be devoted to the training set for developing a better classification model. The experimental results on several datasets, using C4.5 classifier, shows that any equidistributed data partitioning in between (20%, 80%) and (30%, 70%) may be considered as the best sample partition to build classification model irrespective to domain, size and class imbalanced.

Keywords: case study; data partitioning; classification; C4.5; modelling; machine learning; samples; training sets; sampling; sample partitions.

DOI: 10.1504/IJIDS.2016.075788

International Journal of Information and Decision Sciences, 2016 Vol.8 No.1, pp.73 - 91

Received: 13 May 2014
Accepted: 10 Oct 2014
Published online: 05 Apr 2016 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article