Sources of Validity Evidence for Educational and Psychological Tests
- 9 November 2007
- journal article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 68 (3), 397-412
- https://doi.org/10.1177/0013164407310130
Abstract
This study investigates aspects of validity reflected in a large and diverse sample of published measures used in educational and psychological testing contexts. The current edition of Mental Measurements Yearbook served as the data source for this study. The validity aspects investigated included perspective on validity represented, number and kinds of sources of validity evidence provided, overall evaluation of the favorability of the test, and whether these factors varied as a function of the type of test. Findings reveal that validity information is not routinely provided in terms of modern validity theory, some sources of validity evidence (e.g., consequential) are essentially ignored in validity reports, and the favorability of judgments about a test is more strongly related to the number of validity sources provided than to the perspective on validity taken or other factors. The article concludes with implications for extending and refining current validity theory and validation practice.Keywords
This publication has 7 references indexed in Scilit:
- Measurement 101: Some Fundamentals RevisitedEducational Measurement: Issues and Practice, 2005
- An Empirical Study of Reporting Practices Concerning Measurement ValidityEducational and Psychological Measurement, 2004
- The Concept of Validity.Psychological Review, 2004
- A Historical Comparison of Validity Standards and Validity PracticesEducational and Psychological Measurement, 1998
- The Centrality of Test Use and Consequences for Test ValidityEducational Measurement: Issues and Practice, 1997
- Test validity and the ethics of assessment.American Psychologist, 1980
- Must all tests be valid?American Psychologist, 1961