Title: Systematic performance evaluation using component-in-the-loop approach

Authors: Imre Kocsis; Attila Klenik; András Pataricza; Miklós Telek; Flórián Deé; Dávid Cseh

Addresses: Department of Measurement and Information Systems, Budapest University of Technology and Economics, Hungary ' Department of Measurement and Information Systems, Budapest University of Technology and Economics, Hungary ' Department of Measurement and Information Systems, Budapest University of Technology and Economics, Hungary ' Department of Networked Systems and Services, Budapest University of Technology and Economics, Hungary ' Department of Measurement and Information Systems, Budapest University of Technology and Economics, Hungary ' Department of Measurement and Information Systems, Budapest University of Technology and Economics, Hungary

Abstract: Timeliness and throughput critical applications require a framework offering predictable temporal characteristics. The best practice for estimating a prediction of the system dynamics relies on benchmarking. Each novel middleware solution needs such an evaluation as part of the development process to assure an appropriate throughput in the future use. General purpose blockchain frameworks are viable replacements for many current systems in several sectors by providing a fully distributed, secure, and non-repudiable ledger as a service. Blockchain technologies target domains with a large number of interactions, thus demanding strict performance guarantees. Engineering for performance targets in a trustworthy manner requires performance models. However, performance characteristics of blockchain systems are highly unexplored due to the novelty of the technology. This paper proposes a general-purpose, systematic methodology for the performance analysis of complex systems, aided by a component-in-the-loop approach. The Linux foundation-hosted hyperledger fabric serves as a case study for the presented methodology.

Keywords: performance evaluation; blockchain; systematic analysis; hierarchical analysis; component-in-the-loop; CIL; exploratory data analysis; EDA; sensitivity analysis; hyperledger fabric.

DOI: 10.1504/IJCC.2018.095401

International Journal of Cloud Computing, 2018 Vol.7 No.3/4, pp.336 - 357

Received: 03 Aug 2017
Accepted: 16 May 2018
Published online: 03 Oct 2018 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article