Development of an automated assessment tool for MedWatch reports in the FDA adverse event reporting system
Open Access
- 21 March 2017
- journal article
- research article
- Published by Oxford University Press (OUP) in Journal of the American Medical Informatics Association
- Vol. 24 (5), 913-920
- https://doi.org/10.1093/jamia/ocx022
Abstract
Objective: As the US Food and Drug Administration (FDA) receives over a million adverse event reports associated with medication use every year, a system is needed to aid FDA safety evaluators in identifying reports most likely to demonstrate causal relationships to the suspect medications. We combined text mining with machine learning to construct and evaluate such a system to identify medication-related adverse event reports. Methods: FDA safety evaluators assessed 326 reports for medication-related causality. We engineered features from these reports and constructed random forest, L1 regularized logistic regression, and support vector machine models. We evaluated model accuracy and further assessed utility by generating report rankings that represented a prioritized report review process. Results: Our random forest model showed the best performance in report ranking and accuracy, with an area under the receiver operating characteristic curve of 0.66. The generated report ordering assigns reports with a higher probability of medication-related causality a higher rank and is significantly correlated to a perfect report ordering, with a Kendall’s tau of 0.24 (P = .002). Conclusion: Our models produced prioritized report orderings that enable FDA safety evaluators to focus on reports that are more likely to contain valuable medication-related adverse event information. Applying our models to all FDA adverse event reports has the potential to streamline the manual review process and greatly reduce reviewer workload.Keywords
Funding Information
- National Institutes of Health (T32 GM007365)
This publication has 22 references indexed in Scilit:
- Large-scale combining signals from both biomedical literature and the FDA Adverse Event Reporting System (FAERS) to improve post-marketing drug safety signal detectionBMC Bioinformatics, 2014
- Data Mining of the Public Version of the FDA Adverse Event Reporting SystemInternational Journal of Medical Sciences, 2013
- Data-Driven Prediction of Drug Effects and InteractionsScience Translational Medicine, 2012
- Text mining for the Vaccine Adverse Event Reporting System: medical text classification using informative feature selectionJournal of the American Medical Informatics Association, 2011
- Mining multi-item drug adverse effect associations in spontaneous reporting systemsBMC Bioinformatics, 2010
- Drug‐induced torsades de pointes: data mining of the public version of the FDA Adverse Event Reporting System (AERS)Pharmacoepidemiology and Drug Safety, 2009
- Drug-versus-Drug Adverse Event Rate ComparisonsDrug Safety, 2009
- Perspectives on the Use of Data Mining in PharmacovigilanceDrug Safety, 2005
- The Medical Dictionary for Regulatory Activities (MedDRA)Drug Safety, 1999
- Introducing MEDWatch. A new approach to reporting medication and device adverse effects and product problemsPublished by American Medical Association (AMA) ,1993