Developing a Psychometrically Sound Assessment of School Leadership: The VAL-ED as a Case Study
- 19 March 2010
- journal article
- other
- Published by SAGE Publications in Educational Administration Quarterly
- Vol. 46 (2), 135-173
- https://doi.org/10.1177/1094670510361747
Abstract
Research has consistently shown that principal leadership matters for successful schools. Evaluating principals on the behaviors shown to improve student learning should be an important leverage point for raising leadership quality. Yet principals are often evaluated with the use of instruments with no theoretical background and little, if any, documented psychometric properties. To address this need, a team of researchers in principal leadership, assessment development, and psychometrics developed the Vanderbilt Assessment of Leadership in Education (VAL-ED). The purpose here is to report on iterative development work where the instrument was tested and revised across several cycles. Future work to investigate the instrument’s psychometric properties is identified. After an extensive item writing and instrument development phase, the authors embarked on a series of studies designed to guide improvements to the instrument. These studies include a sorting study, two rounds of cognitive interviews, a bias review, and two rounds of small- scale pilot tests. Results and implications from each study are discussed. The iterative development process helped improve the clarity of instructions and items while building a growing collection of preliminary validity and reliability evidence. At the end of the development process, the VAL-ED represents a promising instrument for assessing principal instructional leadership.The VAL- ED also represents a tool for possible use by principal leadership researchers in measuring the effectiveness of school principals.Keywords
This publication has 12 references indexed in Scilit:
- The Evaluation of Principals: What and How Do States and Urban Districts Assess Leadership?The Elementary School Journal, 2009
- Assessing Learning-Centered Leadership: Connections to Research, Professional Standards, and Current PracticesLeadership and Policy in Schools, 2009
- A Suggested Change in Terminology and Emphasis Regarding Validity and EducationEducational Researcher, 2007
- Are We Asking the Right Questions? Using Cognitive Interviews to Improve Surveys in Education ResearchEducational Evaluation and Policy Analysis, 2004
- Principal Leadership and School Performance: An Integration of Transformational and Instructional LeadershipEducational Administration Quarterly, 2003
- SELF‐OTHER AGREEMENT: DOES IT REALLY MATTER?Personnel Psychology, 1998
- Leadership for School RestructuringEducational Administration Quarterly, 1994
- The Interplay of Evidence and Consequences in the Validation of Performance AssessmentsEducational Researcher, 1994
- The folklore of principal evaluationJournal of Personnel Evaluation in Education, 1990
- A META‐ANALYSIS OF SELF‐SUPERVISOR, SELF‐PEER, AND PEER‐SUPERVISOR RATINGSPersonnel Psychology, 1988