Interviewer variation and the co-construction of speaking proficiency
- 1 January 2003
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 20 (1), 1-25
- https://doi.org/10.1191/0265532203lt242oa
Abstract
Whilst claims to validity for conversational oral interviews as measures of nontest conversational skills are based largely on the unpredictable or impromptu nature of the test interaction, ironically this very feature is also likely to lead to a lack of standardisation across interviews, and hence potential unfairness. This article addresses the question of variation amongst interviewers in the ways they elicit demonstrations of communicative ability and the impact of this variation on candidate performance and, hence, raters’ perceptions of candidate ability. Through a discourse analysis of two interviews involving the same candidate with two different interviewers, it illustrates how intimately the interviewer is implicated in the construction of candidate proficiency. The interviewers differed with respect to the ways in which they structured sequences of topical talk, their questioning techniques, and the type of feedback they provided. An analysis of verbal reports produced by some of the raters confirmed that these differences resulted in different impressions of the candidate’s ability: in one interview the candidate was considered to be more ‘effective’ and ‘willing’ as a communicator than in the other. The paper concludes with a discussion of the implications for rater training and test design.Keywords
This publication has 21 references indexed in Scilit:
- Meaning Negociation in the Hungarian Oral Proficiency Examination of EnglishPublished by John Benjamins Publishing Company ,1998
- Re-analyzing the OPIPublished by John Benjamins Publishing Company ,1998
- The effect of interlocutor and assessment mode variables in overseas assessments of speaking skills in occupational I settingsLanguage Testing, 1997
- Assessor accommodation in the V.C.E. Italian oral testAustralian Review of Applied Linguistics, 1997
- Interlocutor support in oral proficiency interviews: the case of CASELanguage Testing, 1996
- Investigating variability in tasks and rater judgements in a performance test of foreign language speakingLanguage Testing, 1995
- Conversation AnalysisPublished by SAGE Publications ,1995
- Examining expert judgments of task difficulty on essay testsJournal of Second Language Writing, 1994
- The structural organization of a language interview: A conversation analytic perspectiveSystem, 1992
- Problems in Examining the Validity of the ACTFL Oral Proficiency InterviewStudies in Second Language Acquisition, 1988