Sample Compositions and Variabilities in Published Studies versus Those in Test Manuals: Validity of Score Reliability Inductions
- 1 August 2000
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 60 (4), 509-522
- https://doi.org/10.1177/00131640021970682
Abstract
As measurement specialists, we have done a disservice to both ourselves and our profession by habitually referring to “the reliability of the test,” or saying that “the test is reliable.” This has created a mind-set implying that reliability, once proven, is immutable. More important, practitioners and scholars need not know measurement theories if they may simply rely on the reliability purportedly intrinsic within all uses of established measures. The present study investigated empirically exactly how dissimilar in both composition and variability samples inducting reliability coefficients from prior studies were from the cited prior samples from which coefficients were generalized.Keywords
This publication has 26 references indexed in Scilit:
- Reporting Practices and APA Editorial Policies Regarding Statistical Significance and Effect SizeTheory & Psychology, 2000
- Psychometrics Is Datametrics: The Test Is Not ReliableEducational and Psychological Measurement, 2000
- Psychometrics is Datametrics: the Test is not ReliableEducational and Psychological Measurement, 2000
- Practices Regarding Reporting of Reliability Coefficients: A Review of Three JournalsThe Journal of Experimental Education, 1999
- How Well Do Researchers Report their Measures? an Evaluation of Measurementin Published Educational ResearchEducational and Psychological Measurement, 1998
- Research Techniques in "AERJ" Articles: 1969 to 1978Educational Researcher, 1980
- Bem Sex Role Inventory: A theoretical and methodological critique.Journal of Personality and Social Psychology, 1979
- Theory and measurement of androgyny: A reply to the Pedhazur-Tetenbaum and Locksley-Colten critiques.Journal of Personality and Social Psychology, 1979
- Masculinity-femininity: An exception to a famous dictum?Psychological Bulletin, 1973