Developing machine learning-based models to help identify child abuse and neglect: key ethical challenges and recommended solutions
- 13 January 2022
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 29 (3), 576-580
- https://doi.org/10.1093/jamia/ocab286
Abstract
Child abuse and neglect are public health issues impacting communities throughout the United States. The broad adoption of electronic health records (EHR) in health care supports the development of machine learning–based models to help identify child abuse and neglect. Employing EHR data for child abuse and neglect detection raises several critical ethical considerations. This article applied a phenomenological approach to discuss and provide recommendations for key ethical issues related to machine learning–based risk models development and evaluation: (1) biases in the data; (2) clinical documentation system design issues; (3) lack of centralized evidence base for child abuse and neglect; (4) lack of “gold standard “in assessment and diagnosis of child abuse and neglect; (5) challenges in evaluation of risk prediction performance; (6) challenges in testing predictive models in practice; and (7) challenges in presentation of machine learning–based prediction to clinicians and patients. We provide recommended solutions to each of the 7 ethical challenges and identify several areas for further policy and research.Funding Information
- Data Science Institute Seed Funds Program at Columbia University
This publication has 35 references indexed in Scilit:
- Barriers and Facilitators to Detecting Child Abuse and Neglect in General Emergency DepartmentsAnnals of Emergency Medicine, 2015
- Penalization, bias reduction, and default priors in logistic and related categorical and survival regressionsStatistics in Medicine, 2015
- Automated identification of extreme-risk events in clinical incident reportsJournal of the American Medical Informatics Association, 2012
- Racial Bias in Child Protection? A Comparison of Competing Explanations Using National DataPEDIATRICS, 2011
- A randomized-controlled trial of computerized alerts to reduce unapproved medication abbreviation useJournal of the American Medical Informatics Association, 2011
- Humerus fractures in the pediatric population: an algorithm to identify abuseJournal of Pediatric Orthopaedics B, 2010
- The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies*Bulletin of the World Health Organization, 2007
- Children With Signs of AbusePathology Patterns Reviews, 2005
- Screening Children for Family Violence: A Review of the Evidence for the US Preventive Services Task ForceAnnals of Family Medicine, 2004
- Discourses of Child Protection and Child WelfareThe British Journal of Social Work, 1997