Full text loading...
-
Assessing Short-term Change in Advanced Oral Proficiency
Problems of Reliability & Validity in Four Case Studies
- Source: ITL - International Journal of Applied Linguistics, Volume 109, Issue 1, Jan 1995, p. 75 - 109
Abstract
This paper presents four case studies to demonstrate developments in oral proficiency made by advanced learners of English during two months in England. The data base consists of picture story oral narratives. Performance shortly after arrival in Britain is compared with that at the end of the two months. Assessment was by:
subjective reactions of a panel of experienced native-speaker EFL teachers
quantitative analysis of transcriptions of recordings.
An attempt is made to apply VORSTER’s (1980) components of proficiency developed for use with children mother tongue speakers. The main findings were as follows:
There was considerable dissension among teachers, so that the reliability of subjective teacher assessment in such cases must be seriously questioned.
Results on the objective quantitative measures were very chequered, suggesting that the variables chosen did not, in many cases, function well to identify developments over so short a period.
Nevertheless, there were clear trends towards improvements in productivity and modality (co-verbs).
There were signs of individual differences among subjects in route of development.