Title: Facilitated expert judgment of environmental risks: acquiring and analysing imprecise data

Authors: Louisa Flander; William Dixon; Marissa McBride; Mark Burgman

Addresses: Centre for Molecular, Environmental, Genetic and Analytic Epidemiology, University of Melbourne, Victoria 3010, Australia ' Department of Primary Industries, Fisheries Victoria, P.O. Box 300, East Melbourne, Victoria 8002, Australia ' School of Botany, University of Melbourne, Victoria 3010, Australia ' School of Botany, University of Melbourne, Victoria 3010, Australia

Abstract: Expert judgment is essential for most practical, science-based risk analyses and forecasts. Typically, experts are asked to provide judgments in precise quantitative language. This requirement is a significant impediment to accurate and well-calibrated judgments because many scientists routinely misinterpret formal statistical language and concepts. Cognitive biases compound these conceptual and linguistic misunderstandings, compromising potentially vital information. We designed a protocol to remedy this problem, using a trained facilitator who deployed a range of techniques to elicit knowledge for a case study of recycled water contamination. The elicitation generated a range of imprecise information about the parameter, which we translated into constraints for probability bounds analysis. This approach allows experts to use forms of reasoning and communication best suited to them. We show how to represent and combine expert knowledge, and discuss the use of probability bounds analysis to supplement expert elicitation by framing risk problems in heuristic and mathematical terms.

Keywords: expert judgment; imprecise data; environmental risk assessment; probability bounds; uncertainty; expert elicitation; environmental risks; cognitive bias; linguistic misunderstanding; recycled water; water pollution; reasoning; communication; expert knowledge.

DOI: 10.1504/IJRAM.2012.051259

International Journal of Risk Assessment and Management, 2012 Vol.16 No.4, pp.199 - 212

Received: 12 Sep 2011
Accepted: 25 May 2012

Published online: 29 Oct 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article