Prospective Development and Validation of the Computerized Adaptive Screen for Suicidal Youth
- 1 May 2021
- journal article
- research article
- Published by American Medical Association (AMA) in JAMA Psychiatry
- Vol. 78 (5), 540-549
- https://doi.org/10.1001/jamapsychiatry.2020.4576
Abstract
Importance The rate of suicide among adolescents is rising in the US, yet many adolescents at risk are unidentified and receive no mental health services. Objective To develop and independently validate a novel computerized adaptive screen for suicidal youth (CASSY) for use as a universal screen for suicide risk in medical emergency departments (EDs). Design, Setting, and Participants Study 1 of this prognostic study prospectively enrolled adolescent patients at 13 geographically diverse US EDs in the Pediatric Emergency Care Applied Research Network. They completed a baseline suicide risk survey and participated in 3-month telephone follow-ups. Using 3 fixed Ask Suicide-Screening Questions items as anchors and additional items that varied in number and content across individuals, we derived algorithms for the CASSY. In study 2, data were collected from patients at 14 Pediatric Emergency Care Applied Research Network EDs and 1 Indian Health Service hospital. Algorithms were independently validated in a prospective cohort of adolescent patients who also participated in 3-month telephone follow-ups. Adolescents aged 12 to 17 years were consecutively approached during randomly assigned shifts. Exposures Presentation at an ED. Main Outcome and Measure A suicide attempt between ED visit and 3-month follow-up, measured via patient and/or parent report. Results The study 1 CASSY derivation sample included 2075 adolescents (1307 female adolescents [63.0%]; mean [SD] age, 15.1 [1.61] years) with 3-month follow-ups (72.9% retention [2075 adolescents]). The study 2 validation sample included 2754 adolescents (1711 female adolescents [62.1%]; mean [SD] age, 15.0 [1.65] years), with 3-month follow-ups (69.5% retention [2754 adolescents]). The CASSY algorithms had excellent predictive accuracy for suicide attempt (area under the curve, 0.89 [95% CI, 0.85-0.91]) in study 1. The mean number of adaptively administered items was 11 (range, 5-21). At a specificity of 80%, the CASSY had a sensitivity of 83%. It also demonstrated excellent accuracy in the study 2 validation sample (area under the curve, 0.87 [95% CI, 0.85-0.89]). In this study, the CASSY had a sensitivity of 82.4% for prediction of a suicide attempt at the 80% specificity cutoff established in study 1. Conclusions and Relevance In this study, the adaptive and personalized CASSY demonstrated excellent suicide attempt risk recognition, which has the potential to facilitate linkage to services.Keywords
This publication has 28 references indexed in Scilit:
- The Computerized Adaptive Diagnostic Test for Major Depressive Disorder (CAD-MDD)British Journal of Psychology, 2013
- Ask Suicide-Screening Questions (ASQ)Archives of Pediatrics & Adolescent Medicine, 2012
- Development of a Computerized Adaptive Test for DepressionArchives of General Psychiatry, 2012
- Adolescent and Parent Attitudes Toward Screening for Suicide Risk and Mental Health Problems in the Pediatric Emergency DepartmentPediatric Emergency Care, 2012
- Item Banks for Measuring Emotional Distress From the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, Anxiety, and AngerAssessment, 2011
- Receiver Operating Characteristic Curve in Diagnostic Test AssessmentJournal of Thoracic Oncology, 2010
- Adolescent Suicide Risk Screening in the Emergency DepartmentAcademic Emergency Medicine, 2009
- Mental Health Problems in Children and Caregivers in the Emergency Department SettingJournal of Developmental & Behavioral Pediatrics, 2007
- Full-Information Item Bifactor Analysis of Graded Response DataApplied Psychological Measurement, 2007
- Full-information item bi-factor analysisPsychometrika, 1992