Title: Taguchi methods in software quality testing

Authors: George J. Besseris

Addresses: Postgraduate Program (MSc) in Quality Management, Technological Educational Institute of Piraeus, Methonis 8-10, Attiki, Greece; The University of the West of Scotland, Paisley, Scotland, UK

Abstract: Quality optimisation methods offer a structured way of improving software development as early as in the product design phase. This work introduces the Taguchi method in software design optimisation. The basics of the method are reviewed along with a proposed methodology for design of experiments (DOE). A case study is drawn from a real software development project in the area of industrial simulations. One critical quality characteristic in simulations software is the software performance. A key performance metric, the code total execution time, is selected to monitor experimentally performance variation. Taguchi|s DOE is employed to provide a practical relationship between code structure factors and factor interactions and the performance metric. The run-time performance evaluation of two alternate versions of multiple loop-nesting are analysed by Taguchi|s signal-to-noise ratio (SNR) concept. The purpose of the paper was to insinuate the usefulness of these statistical tools in assessing software quality metrics based on a scientific approach. It is demonstrated that performance optimisation enhances execution time by a factor of three with respect to the expected value.

Keywords: software quality testing; optimisation; design of experiments; DOE; Taguchi methods; analysis of variance; ANOVA; industrial simulation; quality engineering; software testing; software development; software design optimisation.

DOI: 10.1504/IJQET.2010.034615

International Journal of Quality Engineering and Technology, 2010 Vol.1 No.3, pp.339 - 372

Published online: 13 Aug 2010 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article