DiD IT?: A differences-in-differences investigation tool to quantify the impact of local incidents on public health using real-time syndromic surveillance health data.
Open Access
- 15 March 2023
- journal article
- research article
- Published by Cambridge University Press (CUP) in Epidemiology and Infection
- Vol. 151, 1-11
- https://doi.org/10.1017/s0950268823000444
Abstract
Syndromic surveillance was originally developed to provide early warning compared to laboratory surveillance, but it is increasing used for real-time situational awareness. When a potential threat to public health is identified, a rapid assessment of its impact is required for public health management. When threats are localised, analysis is more complex as local trends need to be separated from national trends and differences compared to unaffected areas may be due to confounding factors such as deprivation or age distributions. Accounting for confounding factors usually requires an in-depth study, which takes time. Therefore, a tool is required which can provide a rapid estimate of local incidents using syndromic surveillance data.Here, we present 'DiD IT?', a new investigation tool designed to measure the impact of local threats to public health. 'DiD IT?' uses a difference-in-differences statistical approach to account for temporal and spatial confounding and provide a direct estimate of impact due to incidents. Temporal confounding differences are estimated by comparing unaffected locations during and outside of exposure periods. Whilst spatial confounding differences are estimated by comparing unaffected and exposed locations outside of the exposure period. Any remaining differences can be considered to be the direct effect of the local incident.We illustrate the potential utility of the tool through four examples of localised health protection incidents in England. The examples cover a range of data sources including general practitioner (GP) consultations, emergency department (ED) attendances and a telehealth call and online health symptom checker; and different types of incidents including, infectious disease outbreak, mass-gathering, extreme weather and an industrial fire. The examples use the UK Health Security Agency's ongoing real-time syndromic surveillance systems to show how results can be obtained in near real-time.The tool identified 700 additional online difficulty breathing assessments associated with a severe thunderstorm, 53 additional GP consultations during a mumps outbreak, 2-3 telehealth line calls following an industrial fire and that there was no significant increase in ED attendances during the G7 summit in 2021.DiD IT? can provide estimates for the direct impact of localised events in real-time as part of a syndromic surveillance system. Thus, it has the potential for enhancing surveillance and can be used to evaluate the effectiveness of extending national surveillance to a more granular local surveillance.Keywords
This publication has 19 references indexed in Scilit:
- Novel public health risk assessment process developed to support syndromic surveillance for the 2012 Olympic and Paralympic GamesJournal of Public Health, 2016
- What is the utility of using syndromic surveillance systems during large subnational infectious gastrointestinal disease outbreaks? An observational study using case studies from the past 5 years in EnglandEpidemiology and Infection, 2016
- Developing and validating a new national remote health advice syndromic surveillance system in EnglandJournal of Public Health, 2016
- The application of a novel ‘rising activity, multi-level mixed effects, indicator emphasis’ (RAMMIE) method for syndromic surveillance in EnglandBioinformatics, 2015
- Syndromic surveillance for local outbreak detection and awareness: evaluating outbreak signals of acute gastroenteritis in telephone triage, web-based queries and over-the-counter pharmacy salesEpidemiology and Infection, 2013
- Developing a new syndromic surveillance system for the London 2012 Olympic and Paralympic GamesEpidemiology and Infection, 2012
- Establishing an emergency department syndromic surveillance system to support the London 2012 Olympic and Paralympic GamesEmergency Medicine Journal, 2012
- Syndromic Surveillance for Local Outbreaks of Lower-Respiratory Infections: Would It Work?PLOS ONE, 2010
- Can syndromic surveillance data detect local outbreaks of communicable disease? A model using a historical cryptosporidiosis outbreakEpidemiology and Infection, 2005
- Impact of NHS walk-in centres on the workload of other local healthcare providers: time series analysisBMJ, 2003