Title: Performance criteria for the benchmarking of air quality model regulatory applications: the 'target' approach

Authors: Anna Pederzoli; Philippe Thunis; Emilia Georgieva; Rafael Borge; David Carruthers; Denise Pernigotti

Addresses: Department of Information Engineering, University of Brescia, Via Branze 38, I-25123 Brescia, Italy ' Joint Research Centre of the European Commission (JRC), TP 441 – Office 134, Via Enrico Fermi 2749, I-21027 Ispra (VA), Italy ' Joint Research Centre of the European Commission (JRC), TP 441 – Office 134, Via Enrico Fermi 2749, I-21027 Ispra (VA), Italy ' Departamento de Ingeniería Química Industrial y del Medio Ambiente, Universidad Politécnica de Madrid (UPM), C/ José Gutiérrez Abascal, 2. 28006 – Madrid, Spain ' Cambridge Environmental Research Consultants, 3 King's Parade, Cambridge, CB2 1SJ, UK ' Joint Research Centre of the European Commission (JRC), TP 441 – Office 134, I-21027 Ispra (VA), Italy

Abstract: The definition of appropriate performance criteria is one of the key issues for the benchmarking of air quality models in regulatory applications. As part of the FAIRMODE benchmarking activities (Thunis et al., 2010), suitable criteria for air quality modelling in the frame of the EU air quality directive (AQD) 2008 are proposed and tested. The suggested approach builds on the target indicator (Jolliff et al., 2009) as support to the relative directive error, the current official statistical parameter as defined in the AQD (EEA, 2011), for quantitatively estimating model performances in air quality modelling applications. This study describes the advantages of using the target compared to the actual limitations of RDE and addresses the main links between the target and some 'traditional' statistical indicators (MFB, R, FAC2, σ). It also describes the application of this methodology to NO₂, O₃ and PM₁₀ concentrations on three different model-observations datasets. Among these datasets two focus on the urban areas of Madrid and London and include modelled results provided by the air quality models CMAQ and ADMS-Urban for years 2007 and 2008 respectively. One other dataset (POMI) covering the Po valley and including multiple model results has also been tested for year 2005.

Keywords: FAIRMODE benchmarking; model evaluation; performance criteria; target diagram; air quality; air pollution; atmospheric dispersion modelling; regulatory applications; regulations; EU Directives; Air Quality Directive; AQD; European Union; Madrid; London; Po valley; NO2; nitrogen dioxide; O3; ozone PM10; particulate matter.

DOI: 10.1504/IJEP.2012.051191

International Journal of Environment and Pollution, 2012 Vol.50 No.1/2/3/4, pp.175 - 189

Published online: 19 Nov 2014 *

Full-text access for editors Full-text access for subscribers Purchase this article Comment on this article