False Alarms and Close Calls: A Conceptual Model of Warning Accuracy
- 1 October 2007
- journal article
- Published by American Meteorological Society in Weather and Forecasting
- Vol. 22 (5), 1140-1147
- https://doi.org/10.1175/waf1031.1
Abstract
The false alarm rate (FAR) measures the fraction of forecasted events that did not occur, and it remains one of the key metrics for verifying National Weather Service (NWS) weather warnings. The national FAR for tornado warnings in 2003 was 0.76, indicating that only one in four tornado warnings was verified. The NWS’s goal for 2010 is to reduce this value to 0.70. Conventional wisdom is that false alarms reduce the public’s willingness to respond to future events. This paper questions this conventional wisdom. In addition, this paper argues that the metrics used to evaluate false alarms do not accurately represent the numbers of actual false alarms or the forecasters’ abilities because current metrics categorize events as either a hit or a miss and do not give forecasters credit for close calls. Aspects discussed in this paper include how the NWS FAR is measured, how humans respond to warnings, and what are alternative approaches to measure FAR. A conceptual model is presented as a framework for a new perspective on false alarms that includes close calls, providing a more balanced view of forecast verification.Keywords
This publication has 18 references indexed in Scilit:
- Buyer Beware: Some Words of Caution on the Use of Severe Wind Reports in Postevent Assessment and ResearchWeather and Forecasting, 2006
- TORNADO-WARNING PERFORMANCE IN THE PAST AND FUTURE: A Perspective from Signal Detection TheoryBulletin of the American Meteorological Society, 2004
- Communicating Environmental Risk in Multiethnic CommunitiesPublished by SAGE Publications ,2004
- Warning Decision Making: The Relative Roles of Conceptual Models, Technology, Strategy, and Forecaster Expertise on 3 May 1999Weather and Forecasting, 2002
- Severe Local Storms ForecastingMeteorological Monographs, 2001
- Statistical Methods in the Atmospheric SciencesJournal of the American Statistical Association, 2000
- Atlantic Hurricane Season of 1996Monthly Weather Review, 1999
- Who decides? Forecasts and responsibilities in the 1997 Red River floodApplied Behavioral Science Review, 1999
- Crying wolf: Repeat responses to hurricane evacuation ordersCoastal Management, 1998
- WarningPublished by Springer Science and Business Media LLC ,1986