What are the characteristics of natural cloze tests?
- 1 July 1993
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 10 (2), 93-116
- https://doi.org/10.1177/026553229301000201
Abstract
This study investigates the characteristics of natural cloze tests. Natural cloze tests are defined here as cloze procedures developed without intercession based on the test developer's knowledge and intuitions about passage difficulty, suitable topics, etc. (i.e., the criteria which are often used to select a cloze passage appropriate for a particular group of students). Fifty reading passages were randomly selected from an American public library. Each passage was made into a 30-item cloze test (every twelfth word deletion). The subjects were 2298 EFL students from 18 colleges and universities in Japan. Each student completed one of the 30-item cloze tests. The 50 cloze tests were randomly administered across all of the subjects so that any variations in statistical characteristics could be assumed to be due to other than sampling differences. The students also took a 10-item cloze test that was common to all students. The 50 cloze tests were compared in terms of descriptive, reliability and validity testing characteristics. The results indicate that natural cloze tests are not necessarily well-centred, reliable and valid. A typical natural cloze is described, but considerable variations were also found in the characteristics of these cloze tests (with many of them having skewed distributions and/or poor reliability). The implications for cloze test construction and use are discussed.Keywords
This publication has 13 references indexed in Scilit:
- Tailored cloze: improved with classical item analysis techniquesLanguage Testing, 1988
- Textual Cohesion and Second‐Language Comprehension*Language Learning, 1987
- Performance on Cloze Tests with Fixed-Ratio and Rational DeletionsTESOL Quarterly, 1985
- Relative Merits of Four Methods for Scoring Cloze TestsThe Modern Language Journal, 1980
- NATIVE AND NONNATIVE SPEAKER PERFORMANCE ON CLOZE TESTS1Language Learning, 1980
- IMPROVING ON THE BASIC EGG: THE M‐C CLOZELanguage Learning, 1976
- CLOZE, DICTATION, AND THE TEST OF ENGLISH AS A FOREIGN LANGUAGELanguage Learning, 1974
- Scoring Methods and Difficulty Levels for Cloze Tests of Proficiency in English as a Second LanguageThe Modern Language Journal, 1972
- Clozentropy: A procedure for testing English language proficiency of foreign studentsSpeech Monographs, 1970
- The theory of the estimation of test reliabilityPsychometrika, 1937