Next-generation systematic reviews: prospective meta-analysis, individual-level data, networks and umbrella reviews
- 21 February 2017
- journal article
- review article
- Published by BMJ in British Journal of Sports Medicine
- Vol. 51 (20), 1456-1458
- https://doi.org/10.1136/bjsports-2017-097621
Abstract
Systematic reviews and meta-analyses have reached a critical point. Their success is solid and dreadful at the same time. They are widely considered the highest level of evidence. There are tens of thousands of systematic reviews already published, but their production is still increasing geometrically. The problem is that the majority of systematic reviews are flawed, misleading, redundant, useless or all of the above,1 and this applies to almost all medical fields, including sports and exercise medicine. Part of the problem with systematic reviews stems from the poor, misleading primary evidence2 that authors try to synthesise and make sense of. However, if this were the only major problem, systematic reviews and meta-analyses would still be extremely useful. They could focus exactly on showing how flawed, misleading and useless this evidence is. This could lead to suggestions on how to improve research in the field. Instead, systematic reviews often sanctify results from poor studies, by making these seem even more statistically significant and (spuriously) conclusive. They can also compound the problems seen in the primary studies, if they are driven by reviewers and sponsors with conflicts of interest, financial or academic. There are four types of ‘next-generation’ systematic reviews that may raise the bar and help shape a new generation of more reliable evidence synthesis: prospective meta-analysis, individual-level data, network meta-analyses and umbrella reviews. They are not necessarily brand new ideas, but in the current circumstances of uncontrollable overproduction and unchecked quality, they have a fresh opportunity for impact. This large-scale impact would have been unimaginable in the past due to constrains in access to data, limited availability of sophisticated methods and fewer opportunities for their application. None of these next-generation tools are bullet proof, but they hold promise and some distinct advantages. Their disadvantages also need to be …Keywords
This publication has 32 references indexed in Scilit:
- The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analysesThe Milbank Quarterly, 2016
- A decade of individual participant data meta-analyses: A review of current practiceContemporary Clinical Trials, 2015
- Drug-safety alerts issued by regulatory authorities: usefulness of meta-analysis in predicting risks earlierEuropean Journal of Clinical Pharmacology, 2014
- The acute effects of physical activity on cigarette cravings: Exploration of potential moderators, mediators and physical activity attributes using individual participant data (IPD) meta-analysesPsychopharmacology, 2014
- The acute effects of physical activity on cigarette cravings: systematic review and meta‐analysis with individual participant dataAddiction, 2012
- Individual patient meta-analysis of exercise training effects on systemic brain natriuretic peptide expression in heart failureEuropean Journal of Preventive Cardiology, 2011
- The need to consider the wider agenda in systematic reviews and meta-analyses: breadth, timing, and depth of the evidenceBMJ, 2010
- The Effects of Exercise on Falls in Elderly PatientsPublished by American Medical Association (AMA) ,1995
- The scandal of poor medical researchBMJ, 1994
- Systemic treatment of early breast cancer by hormonal, cytotoxic, or immune therapy: 133 randomised trials involving 31 000 recurrences and 24 000 deaths among 75 000 womenThe Lancet, 1992