Quantifying the accuracy of forensic examiners in the absence of a “gold standard”.
- 1 January 2010
- journal article
- other
- Published by American Psychological Association (APA) in Law and Human Behavior
- Vol. 34 (5), 402-417
- https://doi.org/10.1007/s10979-009-9197-5
Abstract
This study asked whether latent class modeling methods and multiple ratings of the same cases might permit quantification of the accuracy of forensic assessments. Five evaluators examined 156 redacted court reports concerning criminal defendants who had undergone hospitalization for evaluation or restoration of their adjudicative competence. Evaluators rated each defendant’s Dusky-defined competence to stand trial on a five-point scale as well as each defendant’s understanding of, appreciation of, and reasoning about criminal proceedings. Having multiple ratings per defendant made it possible to estimate accuracy parameters using maximum likelihood and Bayesian approaches, despite the absence of any “gold standard” for the defendants’ true competence status. Evaluators appeared to be very accurate, though this finding should be viewed with caution.Keywords
This publication has 47 references indexed in Scilit:
- Do some evaluators report consistently higher or lower PCL-R scores than others? Findings from a statewide sample of sexually violent predator evaluations.Psychology, Public Policy, and Law, 2008
- Clinician variation in findings of competence to stand trial.Psychology, Public Policy, and Law, 2008
- Combined Screening With Ultrasound and Mammography vs Mammography Alone in Women at Elevated Risk of Breast CancerJAMA, 2008
- Determining when impairment constitutes incapacity for informed consent in schizophrenia researchThe British Journal of Psychiatry, 2007
- MRI Evaluation of the Contralateral Breast in Women with Recently Diagnosed Breast CancerThe New England Journal of Medicine, 2007
- Random Effects Modeling Approaches for Estimating ROC Curves from Repeated Ordinal Tests without a Gold StandardBiometrics, 2007
- Latent class analysis of diagnostic agreementStatistics in Medicine, 1990
- Assessment and conceptualization of competency to stand trial: Preliminary data on the Interdisciplinary Fitness Interview.Law and Human Behavior, 1984
- A new look at the statistical model identificationIEEE Transactions on Automatic Control, 1974
- Construct validity in psychological tests.Psychological Bulletin, 1955