A plea for the proper use of criterion-referenced tests in medical assessment
- 1 December 2009
- journal article
- Published by Wiley in Medical Education
- Vol. 43 (12), 1141-1146
- https://doi.org/10.1111/j.1365-2923.2009.03541.x
Abstract
This paper is aimed at assessment teams which are not steeped in the culture of educational measurement, but, rather, are composed of professionals whose jobs primarily require them to work as clinicians, but whose interest in medical education has given them responsibilities for assessment. It reiterates the difference between criterion-referenced tests and norm-referenced tests. It proposes that those who design and use any assessment in medicine should be clear about which of these approaches to testing they are using. This paper does not present any new results, but synthesises what is already known about norm-referenced and criterion-referenced tests by reviewing some of the literature. It explains how these two test paradigms lead to different approaches to test design, different measures of reliability and different standard errors of measurement. It shows how these factors may lead to differences in the standards set for some assessments. Many common medical assessments are assumed to be criterion-referenced but tend to follow norm-referenced practices. Assessment designers should examine the characteristics of each type of assessment to determine which approach is more appropriate and should then apply the correct theories and methods.Keywords
This publication has 13 references indexed in Scilit:
- Sampling knowledge and understanding: how long should a test be?Assessment & Evaluation in Higher Education, 2006
- A plea for new psychometric models in educational assessmentMedical Education, 2006
- Reliability: on the reproducibility of assessment dataMedical Education, 2004
- Standards and reliability in evaluationAcademic Medicine, 1999
- IRT Estimation of Domain ScoresJournal of Educational Measurement, 1997
- The assessment of professional competence: Developments, research and practical implicationsAdvances in Health Sciences Education, 1996
- The Rise and Fall of Criterion Referenced Measurement?Educational Measurement: Issues and Practice, 1994
- Reliability of Test Scores and DecisionsApplied Psychological Measurement, 1980
- THE ISSUE OF ITEM AND TEST VARIANCE FOR CRITERION‐REFERENCED TESTS: A CLARIFICATIONJournal of Educational Measurement, 1974
- IMPLICATIONS OF CRITERION‐REFERENCED MEASUREMENT1,2Journal of Educational Measurement, 1969