A guide to statistical analysis for single criteria heuristics evaluation Online publication date: Tue, 22-Jan-2008
by Belarmino Adenso-Diaz, Norberto Corral
International Journal of Innovative Computing and Applications (IJICA), Vol. 1, No. 2, 2007
Abstract: The success obtained by metaheuristic techniques in resolving combinatory problems of a real character has led to a veritable explosion in the number of studies in this field. From a scientific perspective, these new approaches must demonstrate improved performance, normally with respect to prior proposals. This involves the carrying out of a series of computational experiments and statistical tests demonstrating their validity. However, in a large number of cases and for diverse causes (a lack of data relative to the benchmark heuristic or due to not knowing the most appropriate statistical tests), some authors fail to present conclusive statistical tests that may be qualified as possessing a minimum level of rigour according to the scientific method. This paper analyses the different tests that may be considered to verify significant differences between the performance of different single criteria heuristics, as well as including a number of application examples, and a discussion about the problem of robustness.
Existing subscribers:
Go to Inderscience Online Journals to access the Full Text of this article.
If you are not a subscriber and you just want to read the full contents of this article, buy online access here.Complimentary Subscribers, Editors or Members of the Editorial Board of the International Journal of Innovative Computing and Applications (IJICA):
Login with your Inderscience username and password:
Want to subscribe?
A subscription gives you complete access to all articles in the current issue, as well as to all articles in the previous three years (where applicable). See our Orders page to subscribe.
If you still need assistance, please email subs@inderscience.com
Our Blog 
Follow us on Twitter 
Visit us on Facebook