Performance of a new symptom checker in patient triage: Canadian cohort study
Open Access
- 1 December 2021
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 16 (12), e0260696
- https://doi.org/10.1371/journal.pone.0260696
Abstract
Computerized algorithms known as symptom checkers aim to help patients decide what to do should they have a new medical concern. However, despite widespread implementation, most studies on symptom checkers have involved simulated patients. Only limited evidence currently exists about symptom checker safety or accuracy when used by real patients. We developed a new prototype symptom checker and assessed its safety and accuracy in a prospective cohort of patients presenting to primary care and emergency departments with new medical concerns. A prospective cohort study was done to assess the prototype’s performance. The cohort consisted of adult patients (≥16 years old) who presented to hospital emergency departments and family physician clinics. Primary outcomes were safety and accuracy of triage recommendations to seek hospital care, seek primary care, or manage symptoms at home. Data from 281 hospital patients and 300 clinic patients were collected and analyzed. Sensitivity to emergencies was 100% (10/10 encounters). Sensitivity to urgencies was 90% (73/81) and 97% (34/35) for hospital and primary care patients, respectively. The prototype was significantly more accurate than patients at triage (73% versus 58%, p<0.01). Compliance with triage recommendations in this cohort using this iteration of the symptom checker would have reduced hospital visits by 55% but cause potential harm in 2–3% from delay in care. The prototype symptom checker was superior to patients in deciding the most appropriate treatment setting for medical issues. This symptom checker could reduce a significant number of unnecessary hospital visits, with accuracy and safety outcomes comparable to existing data on telephone triage.Keywords
Funding Information
- Physicians' Services Incorporated Foundation (Resident Research Grant)
- Schulich School of Medicine and Dentistry (Unnur Brown Award 2018)
This publication has 32 references indexed in Scilit:
- The Use of a Kiosk-Model Bilingual Self-Triage System in the Pediatric Emergency DepartmentPediatric Emergency Care, 2014
- Feasibility of Web-Based Self-Triage by Parents of Children With Influenza-Like IllnessJAMA Pediatrics, 2013
- The appropriateness of, and compliance with, telephone triage decisions: a systematic review and narrative synthesisJournal of Advanced Nursing, 2012
- Low Health Literacy and Health Outcomes: An Updated Systematic ReviewAnnals of Internal Medicine, 2011
- ED patients: how nonurgent are they? Systematic review of the emergency medicine literatureThe American Journal of Emergency Medicine, 2011
- Effect of self-triage on waiting times at a walk-in sexual health clinicBMJ Sexual & Reproductive Health, 2009
- European citizens' use of E-health services: A study of seven countriesBMC Public Health, 2007
- Googling for a diagnosis—use of Google as a diagnostic aid: internet based studyBMJ, 2006
- Web-Based Triage in a College Health SettingJournal of American College Health, 2006
- Inappropriate use of an accident and emergency department: Magnitude, associated factors, and reasons—An approach with explicit criteriaAnnals of Emergency Medicine, 2001