Rasch fit statistics and sample size considerations for polytomous data
Open Access
- 29 May 2008
- journal article
- Published by Springer Science and Business Media LLC in BMC Medical Research Methodology
- Vol. 8 (1), 33
- https://doi.org/10.1186/1471-2288-8-33
Abstract
Previous research on educational data has demonstrated that Rasch fit statistics (mean squares and t-statistics) are highly susceptible to sample size variation for dichotomously scored rating data, although little is known about this relationship for polytomous data. These statistics help inform researchers about how well items fit to a unidimensional latent trait, and are an important adjunct to modern psychometrics. Given the increasing use of Rasch models in health research the purpose of this study was therefore to explore the relationship between fit statistics and sample size for polytomous data. Data were collated from a heterogeneous sample of cancer patients (n = 4072) who had completed both the Patient Health Questionnaire - 9 and the Hospital Anxiety and Depression Scale. Ten samples were drawn with replacement for each of eight sample sizes (n = 25 to n = 3200). The Rating and Partial Credit Models were applied and the mean square and t-fit statistics (infit/outfit) derived for each model. The results demonstrated that t-statistics were highly sensitive to sample size, whereas mean square statistics remained relatively stable for polytomous data. It was concluded that mean square statistics were relatively independent of sample size for polytomous data and that misfit to the model could be identified using published recommended ranges.Keywords
This publication has 25 references indexed in Scilit:
- A Rasch and factor analysis of the Functional Assessment of Cancer Therapy-General (FACT-G)Health and Quality of Life Outcomes, 2007
- Equating EORTC QLQ-C30 and FACT-G scores and its use in oncological researchEuropean Journal of Cancer, 2006
- Rasch analysis of the dimensional structure of the Hospital Anxiety and Depression ScalePsycho‐Oncology, 2005
- The Geriatric Depression Scale should be shortened: results of Rasch analysisInternational Journal of Geriatric Psychiatry, 2005
- Item Parameter Recovery, Standard Error Estimates, and Fit Statistics of the Winsteps Program for the Family of Rasch ModelsEducational and Psychological Measurement, 2005
- The PHQ-9Journal of General Internal Medicine, 2001
- Interpretation of change scores in ordinal clinical scales and health status measures: The whole may not equal the sum of the partsJournal of Clinical Epidemiology, 1996
- Screening for Adjustment Disorders and Major Depressive Disorders in Cancer In-PatientsThe British Journal of Psychiatry, 1990
- The Hospital Anxiety and Depression ScaleActa Psychiatrica Scandinavica, 1983
- Probabilistic Models for some Intelligence and Attainment Tests.Journal of the American Statistical Association, 1982