An epidemiological appraisal instrument – a tool for evaluation of epidemiological studies
- 25 April 2007
- journal article
- research article
- Published by Informa UK Limited in Ergonomics
- Vol. 50 (6), 920-960
- https://doi.org/10.1080/00140130701237667
Abstract
In recent years, ergonomics practices have increasingly relied upon the knowledge derived from epidemiological studies. In this regard, there is limited research devoted to the exclusive evaluation of the methodological qualities of ergonomics epidemiological studies. The aim of this study was to develop and test a general purpose ‘epidemiological appraisal instrument’ (EAI) for evaluating the methodological quality of existing or new ergonomic epidemiological studies using a critical appraisal system rooted in epidemiological principles. A pilot EAI version was developed and tested by a team of epidemiologists/physicians/biostatisticians, with the team leader being both epidemiologist and ergonomist. The pilot version was further tested with regard to other raters with/without a background in epidemiology, biostatistics and ergonomics. A revised version was evaluated for criterion validity and reliability. An assessor with a basic background in epidemiology and biostatistics would be able to correctly respond on four out of five questions, provided that subject matter expertise is obtained on specific items. This may improve with the article's quality. Training may have an effect upon assessors with virtually no background in epidemiology/biostatistics, but with a background in ergonomics. In this latter case, the inter-rater degree of agreement is largely above 90% and assessors can resolve their differences in a subsequent round. The EAI proved to be a valid and reliable appraisal instrument that may be used in various applications, such as systematic reviews and meta-analyses.Keywords
This publication has 14 references indexed in Scilit:
- Systematic review of the safety and effectiveness of methods used to establish pneumoperitoneum in laparoscopic surgeryBritish Journal of Surgery, 2003
- Correlation of Quality Measures With Estimates of Treatment Effect in Meta-analyses of Randomized Controlled TrialsJAMA, 2002
- Are psychosocial factors, risk factors for symptoms and signs of the shoulder, elbow, or hand/wrist?: A review of the epidemiological literatureAmerican Journal of Industrial Medicine, 2002
- Systematic review of population-based epidemiological studies of oro-facial painJournal of Dentistry, 2001
- A systematic review of the relationship between overjet size and traumatic dental injuriesEuropean Journal of Orthodontics, 1999
- Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?The Lancet, 1998
- The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non-randomised studies of health care interventionsJournal of Epidemiology and Community Health, 1998
- Why we need observational studies to evaluate the effectiveness of health careBMJ, 1996
- Evidence based medicine: an approach to clinical problem-solvingBMJ, 1995
- Assessing the quality of randomized controlled trials: An annotated bibliography of scales and checklistsControlled Clinical Trials, 1995