Title: Quantitative performance evaluations for crisis response management: a scoping study

Authors: Nicoletta Baroutsi

Addresses: Division of Risk Management and Societal Safety, Lund University, Rindögatan 26, 115 58 Stockholm, Sweden

Abstract: Evaluation methods are vital tools to support learning and ensure quality in crisis response management (CRM), they provide systematic feedback in situations where it is difficult to understand how separate factors affect the outcome of an event. In this paper, the scoping study methodology is used to examine the range and nature of methods available for evaluating CRM performance. The methods are systematically charted into classes to highlight significant research gaps and examine current trends. The analysis reveals that evaluation methods are not available for all relevant circumstances, that there are no attempts to create empirical baselines, and that the link between effectiveness and a method rarely is brought up. The paper also highlights how doctrinal knowledge may be used to increase interrater reliability, and issues that are complicating statistical validations in this field.

Keywords: performance evaluations; quantitative evaluations; C2; command and control; CRM; crisis response management; evaluation methods; crisis management; analysis; human performance; literature review; scoping study.

DOI: 10.1504/IJEM.2023.131932

International Journal of Emergency Management, 2023 Vol.18 No.2, pp.107 - 143

Received: 21 Sep 2020
Accepted: 22 Oct 2021
Published online: 05 Jul 2023 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article