Risk of bias reporting in the recent animal focal cerebral ischaemia literature
Open Access
- 13 October 2017
- journal article
- review article
- Published by Portland Press Ltd. in Clinical Science
- Vol. 131 (20), 2525-2532
- https://doi.org/10.1042/cs20160722
Abstract
Background: Findings from in vivo research may be less reliable where studies do not report measures to reduce risks of bias. The experimental stroke community has been at the forefront of implementing changes to improve reporting, but it is not known whether these efforts are associated with continuous improvements. Our aims here were firstly to validate an automated tool to assess risks of bias in published works, and secondly to assess the reporting of measures taken to reduce the risk of bias within recent literature for two experimental models of stroke. Methods: We developed and used text analytic approaches to automatically ascertain reporting of measures to reduce risk of bias from full-text articles describing animal experiments inducing middle cerebral artery occlusion (MCAO) or modelling lacunar stroke. Results: Compared with previous assessments, there were improvements in the reporting of measures taken to reduce risks of bias in the MCAO literature but not in the lacunar stroke literature. Accuracy of automated annotation of risk of bias in the MCAO literature was 86% (randomization), 94% (blinding) and 100% (sample size calculation); and in the lacunar stroke literature accuracy was 67% (randomization), 91% (blinding) and 96% (sample size calculation). Discussion: There remains substantial opportunity for improvement in the reporting of animal research modelling stroke, particularly in the lacunar stroke literature. Further, automated tools perform sufficiently well to identify whether studies report blinded assessment of outcome, but improvements are required in the tools to ascertain whether randomization and a sample size calculation were reported.Keywords
This publication has 19 references indexed in Scilit:
- Reducing systematic review workload through certainty-based screeningJournal of Biomedical Informatics, 2014
- Systematic Review and Meta-Analysis of Interventions Tested in Animal Models of Lacunar StrokeStroke, 2014
- Biomedical research: increasing value, reducing wasteThe Lancet, 2014
- Power failure: why small sample size undermines the reliability of neuroscienceNature Reviews Neuroscience, 2013
- A call for transparent reporting to optimize the predictive value of preclinical researchNature, 2012
- Raise standards for preclinical cancer researchNature, 2012
- Believe it or not: how much can we rely on published data on potential drug targets?Nature Reviews Drug Discovery, 2011
- Improving Bioscience Research Reporting: The ARRIVE Guidelines for Reporting Animal ResearchPLoS Biology, 2010
- Empirical Evidence of Bias in the Design of Experimental Stroke StudiesStroke, 2008
- How can we improve the pre-clinical development of drugs for stroke?Trends in Neurosciences, 2007