Use of the false discovery rate for evaluating clinical safety data
Open Access
- 1 June 2004
- journal article
- research article
- Published by SAGE Publications in Statistical Methods in Medical Research
- Vol. 13 (3), 227-238
- https://doi.org/10.1191/0962280204sm363ra
Abstract
Clinical adverse experience (AE) data are routinely evaluated using between group P values for every AE encountered within each of several body systems. If the P values are reported and interpreted without multiplicity considerations, there is a potential for an excess of false positive findings. Procedures based on confidence interval estimates of treatment effects have the same potential for false positive findings as P value methods. Excess false positive findings can needlessly complicate the safety profile of a safe drug or vaccine. Accordingly, we propose a novel method for addressing multiplicity in the evaluation of adverse experience data arising in clinical trial settings. The method involves a two-step application of adjusted P values based on the Benjamini and Hochberg1 false discovery rate (FDR). Data from three moderate to large vaccine trials are used to illustrate our proposed ‘Double FDR’ approach, and to reinforce the potential impact of failing to account for multiplicity. This work was in collaboration with the late Professor John W. Tukey who coined the term ‘Double FDR’.Keywords
This publication has 6 references indexed in Scilit:
- Post-licensure comparative study of unusual high-pitched crying and prolonged crying following COMVAX™ and placebo versus PedvaxHIB™ and RECOMBIVAX HB™ in healthy infantsVaccine, 2002
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- Resampling-based false discovery rate controlling multiple test procedures for correlated test statisticsJournal of Statistical Planning and Inference, 1999
- Controlling Error in Multiple Comparisons, with Examples from State-to-State Differences in Educational AchievementJournal of Educational and Behavioral Statistics, 1999
- A sharper Bonferroni procedure for multiple tests of significanceBiometrika, 1988
- An improved Bonferroni procedure for multiple tests of significanceBiometrika, 1986