Quality of evidence matters: is it well reported and interpreted in infertility journals?
- 23 December 2019
- journal article
- research article
- Published by Springer Science and Business Media LLC in Journal of Assisted Reproduction and Genetics
- Vol. 37 (2), 263-268
- https://doi.org/10.1007/s10815-019-01663-y
Abstract
Purpose To evaluate if the authors of published systematic reviews (SRs) reported the level of quality of evidence (QoE) in the top 5 impact factor infertility journals and to analyze if they used an appropriate wording to describe it. Methods This is a cross-sectional study. We searched in PubMed for SRs published in 2017 in the five infertility journals with the highest impact factor. We analyzed the proportion of SRs published in the top 5 impact factor infertility journals that reported the SRs’ QoE, and the proportion of those SRs in which authors used consistent wording to describe QoE and magnitude of effect. Results The QoE was reported in only 21.4% of the 42 included SRs and in less than 10% of the abstracts. Although we did not find important differences in the report of QoE of those that showed statistically significant differences or not, p value was associated with the wording chosen by the authors. We found inconsistent reporting of the size the effect estimate in 54.8% (23/42) and in the level of QoE in 92.9% (39/42). Whereas the effect size was more consistently expressed in studies with statistically significant findings, QoE was better expressed in those cases in which the p value was over 0.05. Conclusion We found that in 2017, less than 25% of the authors reported the overall QoE when publishing SRs. Authors focused more on statistical significance as a binary concept than on methodological limitations like study design, imprecision, indirectness, inconsistency, and publication bias. Authors should make efforts to report the QoE and interpret results accordingly.Keywords
This publication has 17 references indexed in Scilit:
- The GRADE Working Group clarifies the construct of certainty of evidenceJournal of Clinical Epidemiology, 2017
- New evidence pyramidBMJ Evidence-Based Medicine, 2016
- Misleading reporting and interpretation of results in major infertility journalsFertility and Sterility, 2016
- Overinterpretation and Misreporting of Diagnostic Accuracy Studies: Evidence of “Spin”Radiology, 2013
- Assessment of research quality in major infertility journalsFertility and Sterility, 2012
- GRADE guidelines: 9. Rating up the quality of evidenceJournal of Clinical Epidemiology, 2011
- GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tablesJournal of Clinical Epidemiology, 2011
- Influence of trial registration on reporting quality of randomized trials: Study from highest ranked journalsJournal of Clinical Epidemiology, 2010
- Overinterpretation of Clinical Applicability in Molecular Diagnostic ResearchClinical Chemistry, 2009