Title: Randomisation in designing software tests for systems of systems

Authors: Qianhui Liang; Stuart H. Rubin

Addresses: Cloud and Security Lab, HP Labs Singapore, 1 Fusionopolis Way, Connexis South #14-07, Singapore 138632, Singapore. ' SPAWAR Systems Center Pacific (SSC-Pacific), Code 56340, 53560 Hull Street, San Diego, CA 92152-5001, USA

Abstract: This paper applies randomisation theory to the problem of selecting software test cases for software systems and applications in order to overcome the high costs incurred in testing componentised systems of systems (SoS). We have used a corner point semantics, which can approximate a proof of correctness – termed a pseudo-proof of correctness. Test cases for each component are designed to be mutually orthogonal, or randomised. Integration testing is performed through a composition of the test cases for components with some value-added test cases to cover integration aspects of the system. Integration testing is also designed in such a way that the testing algorithm is written in randomised form. In this paper, we present a theoretical framework for randomising test design for component and integration testing. We also show a meta heuristic algorithm based on the framework to be used with test design methodologies that are randomisation-friendly. The advantages offered by such randomisation are ever present in the algorithm, programming language, integration, and workflow design.

Keywords: randomisation; software components; metaheuristics; service-oriented architecture; SOA; software testing; systems of systems; SOS; test cases; component testing; integration testing; software test design; workflow design.

DOI: 10.1504/IJIDS.2012.047068

International Journal of Information and Decision Sciences, 2012 Vol.4 No.2/3, pp.108 - 129

Published online: 26 May 2012 *

Full-text access for editors Access for subscribers Purchase this article Comment on this article