A framework for evaluating regional-scale numerical photochemical modeling systems
Open Access
- 5 March 2010
- journal article
- research article
- Published by Springer Science and Business Media LLC in Environmental Fluid Mechanics
- Vol. 10 (4), 471-489
- https://doi.org/10.1007/s10652-009-9163-2
Abstract
This paper discusses the need for critically evaluating regional-scale (~200–2,000 km) three-dimensional numerical photochemical air quality modeling systems to establish a model’s credibility in simulating the spatio-temporal features embedded in the observations. Because of limitations of currently used approaches for evaluating regional air quality models, a framework for model evaluation is introduced here for determining the suitability of a modeling system for a given application, distinguishing the performance between different models through confidence-testing of model results, guiding model development and analyzing the impacts of regulatory policy options. The framework identifies operational, diagnostic, dynamic, and probabilistic types of model evaluation. Operational evaluation techniques include statistical and graphical analyses aimed at determining whether model estimates are in agreement with the observations in an overall sense. Diagnostic evaluation focuses on process-oriented analyses to determine whether the individual processes and components of the model system are working correctly, both independently and in combination. Dynamic evaluation assesses the ability of the air quality model to simulate changes in air quality stemming from changes in source emissions and/or meteorology, the principal forces that drive the air quality model. Probabilistic evaluation attempts to assess the confidence that can be placed in model predictions using techniques such as ensemble modeling and Bayesian model averaging. The advantages of these types of model evaluation approaches are discussed in this paper.Keywords
This publication has 55 references indexed in Scilit:
- A method for evaluating spatially-resolved NOx emissions using Kalman filter inversion, direct sensitivities, and space-based NO2 observationsAtmospheric Chemistry and Physics, 2008
- Dynamic evaluation of regional air quality models: Assessing changes in O3 stemming from changes in emissions and meteorologyAtmospheric Environment, 2008
- Evaluating the Predictive and Explanatory Value of Atmospheric Numerical Models: Between Relativism and ObjectivismThe Open Atmospheric Science Journal, 2008
- Modeling assessment of point source NOx emission reductions on ozone air quality in the eastern United StatesAtmospheric Environment, 2008
- Seeking for the rational basis of the Median Model: the optimal combination of multi-model ensemble resultsAtmospheric Chemistry and Physics, 2007
- Linking the Eta Model with the Community Multiscale Air Quality (CMAQ) Modeling System to Build a National Air Quality Forecasting SystemWeather and Forecasting, 2005
- Ensemble dispersion forecasting—Part II: application and evaluationAtmospheric Environment, 2004
- Ensemble dispersion forecasting—Part I: concept, approach and indicatorsAtmospheric Environment, 2004
- Air quality model performance evaluationArchiv für Meteorologie, Geophysik und Bioklimatologie Serie A, 2004
- Relating error bounds for maximum concentration estimates to diffusion meteorology uncertaintyAtmospheric Environment (1967), 1987