1887
Volume 170, Issue 1
  • ISSN 0019-0829
  • E-ISSN: 1783-1490
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This study describes the development of an English and French multiple choice vocabulary test – the tests – that measure learners’ knowledge at four frequency levels up to the most frequent 5,000 words: the 2,000-level, 3,000-level, 4,000-level, and the 5,000-level. The two tests aimed to address some of the limitations of tests currently in use. First, they are sampled from recent frequency lists. Second, they are geared towards Dutch-speaking learners of English and French in Flanders. Third, they attempt to minimize guessing by including an “I don’t know”-option. The findings showed that the tests are internally consistent. Mean scores decreased when the words were less frequent, lending evidence to the tests’ construct validity. Additionally, the tests seem to be able to discriminate between different proficiency levels. As both tests were developed according to the same principles, they can be used to compare learners’ English and French vocabulary knowledge.

Loading

Article metrics loading...

/content/journals/10.1075/itl.17029.pet
2019-04-05
2019-07-22
Loading full text...

Full text loading...

References

  1. Aviad-Levitzky, T., Laufer, B. and Goldstein, Z.
    (in press). The New Computer Adaptive Test of Size and Strength (CATSS): Development and Validation. Language Assessment Quarterly.
    [Google Scholar]
  2. Bardel, C., Gudmundson, A., & Lindqvist, C.
    (2012) Aspects of lexical sophistication in advanced learners’ oral production. Studies in Second Language Acquisition, 34(2), 269–290. doi:  10.1017/S0272263112000058
    https://doi.org/10.1017/S0272263112000058 [Google Scholar]
  3. Batista, R., & Horst, M.
    (2016) A new receptive vocabulary size test for French. The Canadian Modern Language Review / La Revue Canadienne Des Langues Vivantes, 72(2), 211–233. doi:  10.3138/cmlr.2820
    https://doi.org/10.3138/cmlr.2820 [Google Scholar]
  4. Baudot, J.
    (1992) Les fréquences d’utilisation des mots en français écrit contemporain. Montréal: Presses de l’Université de Montréal.
    [Google Scholar]
  5. Bauer, L., & Nation, P.
    (1993) Word families. International Journal of Lexicography, 6(4), 253–279. doi:  10.1093/ijl/6.4.253
    https://doi.org/10.1093/ijl/6.4.253 [Google Scholar]
  6. Beglar, D.
    (2010) A Rasch-based validation of the Vocabulary Size Test. 5(1), 101–118. doi:  10.1177/0265532209340194
    https://doi.org/10.1177/0265532209340194 [Google Scholar]
  7. Beglar, D., & Hunt, A.
    (1999) Revising and validating the 2000 word level and university word level Vocabulary Tests. Language Testing, 16(2), 131–162. doi:  10.1191/026553299666419728
    https://doi.org/10.1191/026553299666419728 [Google Scholar]
  8. Cobb, T.
    (2000) One size fits all? Francophone learners and English vocabulary tests. The Canadian Modern Language Review / La Revue Canadienne Des Langues Vivantes, 57(2), 295–324. doi:  10.3138/cmlr.57.2.295
    https://doi.org/10.3138/cmlr.57.2.295 [Google Scholar]
  9. (2013) FREQUENCY 2.0: Incorporating homoforms and multiword units in pedagogical frequency lists. Eurosla Monograph Series2(2), 79–108
    [Google Scholar]
  10. Coxhead, A.
    (1998) An academic word list (Occasional Publication No. 18), Wellington: LALS, Victoria University of Wellington, New Zealand
    [Google Scholar]
  11. (2000) A new academic word list. TESOL Quarterly, 34(2), 213–38. doi:  10.2307/3587951
    https://doi.org/10.2307/3587951 [Google Scholar]
  12. Davies, M.
    (2008) Corpus of Contemporary American English. Retrieved from corpus.byu.edu/coca/
    [Google Scholar]
  13. Elgort, I.
    (2012) Effects of L1 definitions and cognate status of test items on the Vocabulary Size Test. Language Testing, 30(2), 253–272. doi:  10.1177/0265532212459028
    https://doi.org/10.1177/0265532212459028 [Google Scholar]
  14. Eyckmans, J., Van de Velde, H., Van Hout, R., & Boers, F.
    (2007): Learners’ response behaviour in Yes/No Vocabulary Tests. InH. Daller, J. Milton, & J. Treffers-Daller (Eds.), Modelling and assessing vocabulary knowledge (pp.59–76). Cambridge: Cambridge University Press. 10.1017/CBO9780511667268.006
    https://doi.org/10.1017/CBO9780511667268.006 [Google Scholar]
  15. Gyllstad, H., Vilkaite, L., & Schmitt, N.
    (2015) Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates. ITL – International Journal of Applied Linguistics, 2, 276–303. doi:  10.1075/itl.166.2.04gyl
    https://doi.org/10.1075/itl.166.2.04gyl [Google Scholar]
  16. Karami, H.
    (2012) The development and validation of a bilingual version of the Vocabulary Size Test. RELC Journal, 43(1), 53–67. doi:  10.1177/0033688212439359
    https://doi.org/10.1177/0033688212439359 [Google Scholar]
  17. Kremmel, B.
    (2016) Word families and frequency bands in vocabulary tests: Challenging conventions. TESOL Quarterly, 50(4), 976–987. doi:  10.1002/tesq.329
    https://doi.org/10.1002/tesq.329 [Google Scholar]
  18. Kremmel, B., & Schmitt, N.
    (2016) Interpreting vocabulary test scores: What do various item formats tell us about learners’ ability to employ words?Language Assessment Quarterly, 13(4), 377–392. 10.1080/15434303.2016.1237516
    https://doi.org/10.1080/15434303.2016.1237516 [Google Scholar]
  19. Kučera, H., & Francis, W. N.
    (1967) A computational analysis of present-day American English. Providence, RI: Brown University Press.
    [Google Scholar]
  20. Laufer, B., & Aviad-Levitzky, T.
    (2017) What type of vocabulary knowledge predicts reading comprehension: Word meaning recall or word meaning recognition?Modern Language Journal, 101(4), 729–741. doi: 10.1111/modl.12431
    https://doi.org/10.1111/modl.12431 [Google Scholar]
  21. Laufer, B., & Levitzky-Aviad, T.
    (2018) Loanword proportion in vocabulary size tests: Does it make a difference?ITL-International Journal of Applied Linguistics, 169(1), 95–114. 10.1075/itl.00008.lau
    https://doi.org/10.1075/itl.00008.lau [Google Scholar]
  22. Laufer, B., & McLean, S.
    (2016) Loanwords and vocabulary size test scores: A case of different estimates for different L1 learners. Language Assessment Quarterly, 13(3), 202–217. doi:  10.1080/15434303.2016.1210611
    https://doi.org/10.1080/15434303.2016.1210611 [Google Scholar]
  23. Lindqvist, C., Bardel, C., & Gudmundson, A.
    (2011) Lexical richness in the advanced learner’s oral production of French and Italian L2. IRAL – International Review of Applied Linguistics in Language Teaching, 49(3), 221–240. doi:  10.1515/iral.2011.013
    https://doi.org/10.1515/iral.2011.013 [Google Scholar]
  24. Lindqvist, C., Gudmundson, A., & Bardel, C.
    (2012) A new approach to measuring lexical sophistication in L2 oral production. InCamilla Bardel, Christina Lindqvist & Bhatia Laufer (Eds.), L2 Vocabulary Acquisition, Knowledge and Use (Eurosla Monograph Series 2) (pp.109–126). Paris: Eurosla.
    [Google Scholar]
  25. Lonsdale, D., & Le Bras, Y.
    (2009) A frequency dictionary of French. New York, NY: Routledge. 10.4324/9780203883044
    https://doi.org/10.4324/9780203883044 [Google Scholar]
  26. McLean, S.
    (2017) Evidence for the adoption of the flemma as an appropriate word counting unit. Applied Linguistics. doi: 10.1093/appling/amw050
    https://doi.org/10.1093/appling/amw050 [Google Scholar]
  27. Meara, P., & Jones, G.
    (1990) Eurocentres Vocabulary Size Tests 10KA. Zurich: Eurocentres Learning Service.
    [Google Scholar]
  28. Meara, P., & Milton, J.
    (2003) X_Lex, The Swansea Levels Test. Newbury: Express.
    [Google Scholar]
  29. Milton, J.
    (2007) Lexical profiles, learning styles and the construct validity of lexical size tests. InH. Daller, J. Milton, & J. Treffers-Daller (Eds.), Modelling and Assessing Vocabulary Knowledge (pp.47–58). Cambridge: Cambridge University Press. 10.1017/CBO9780511667268.005
    https://doi.org/10.1017/CBO9780511667268.005 [Google Scholar]
  30. Milton, J., & Vassiliu, P.
    (2000) Frequency and the lexis of low level EFL texts. InK. Nicolaidis, & M. Mattheoudakis (Eds.), Proceedings of the 13th International Symposium on Theoretical and Applied Linguistics (pp.444–455). Thessaloniki, Greece: Aristotle University.
    [Google Scholar]
  31. Mueller Gathercole, V. C., Mon Thomas, E., & Hughes, E.
    (2008) Designing a normed receptive vocabulary test for bilingual populations: A model from Welsh. International Journal of Bilingual Education and Bilingualism, 11(6), 678–720. doi:  10.1080/13670050802149283
    https://doi.org/10.1080/13670050802149283 [Google Scholar]
  32. Nation, P.
    (1983) Testing and teaching vocabulary. Guidelines, 5, 12–25.
    [Google Scholar]
  33. Nation, I. S. P.
    (1990) Teaching and Learning Vocabulary. Heinle & Heinle Publishers.
    [Google Scholar]
  34. (2006) How large a vocabulary is needed for reading and listening?The Canadian Modern Language Review / La Revue Canadienne Des Langues Vivantes, 63(1), 59–82. doi:  10.3138/cmlr.63.1.59
    https://doi.org/10.3138/cmlr.63.1.59 [Google Scholar]
  35. (2012) The BNC/COCA word family lists. Unpublished paper Available at: www.victoria.ac.nz/lals/about/staff/publications/paul-nation/Information-on-the-BNC_COCA-word-family-lists.pdf
  36. Nation, I. S. P., & Beglar, D.
    (2007) A vocabulary size test. The Language Teacher, 31(7), 9–13.
    [Google Scholar]
  37. Noreillie, A., Kestemont, B., Heylen, K., Desmet, P., & Peters, E.
    (2018) Vocabulary knowledge and listening comprehension at an intermediate level in English and French as foreign languages An approximate replication study of Stæhr (2009). ITL – International Journal of Applied Linguistics, 169(1), 212–231. doi:  10.1075/itl.00013.nor
    https://doi.org/10.1075/itl.00013.nor [Google Scholar]
  38. Nguyen, L. T. C., & Nation, I. S. P.
    (2011) A bilingual vocabulary size test of English for Vietnamese learners. RELC Journal, 42(1), 86–99. doi:  10.1177/0033688210390264
    https://doi.org/10.1177/0033688210390264 [Google Scholar]
  39. Peters, E.
    (2018) The effect of out-of-class exposure to English language media on learners’ vocabulary knowledge. ITL – International Journal of Applied Linguistics, 169(1), 142–168. doi:  10.1075/itl.00010.pet
    https://doi.org/10.1075/itl.00010.pet [Google Scholar]
  40. Peters, E., Noreillie, A., Heylen, K., Bulté, B., & Desmet, P.
    (in press). The impact of instruction and out-of-school exposure to FL input on learners’ vocabulary knowledge in two languages. Language Learning.
    [Google Scholar]
  41. Sasao, Y., & Webb, S.
    (2017) The word part levels test. Language Teaching Research, 21(2), 12–30. doi:  10.1177/1362168815586083
    https://doi.org/10.1177/1362168815586083 [Google Scholar]
  42. Schmitt, N.
    (2008) Review article: Instructed second language vocabulary learning. Language Teaching Research, 12(3), 329–363. doi:  10.1177/1362168808089921
    https://doi.org/10.1177/1362168808089921 [Google Scholar]
  43. Schmitt, N., Jiang, X., & Grabe, W.
    (2011) The percentage of words known in a text and reading comprehension. Modern Language Journal, 95(1), 26–43. doi:  10.1111/j.1540‑4781.2011.01146.x
    https://doi.org/10.1111/j.1540-4781.2011.01146.x [Google Scholar]
  44. Schmitt, N., Schmitt, D., & Clapham, C.
    (2001) Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, 18(1), 55–88. doi:  10.1177/026553220101800103
    https://doi.org/10.1177/026553220101800103 [Google Scholar]
  45. Stæhr, L. S.
    (2008) Vocabulary size and the skills of listening, reading and writing. Language Learning Journal, 36(2), 139–152. doi:  10.1080/09571730802389975
    https://doi.org/10.1080/09571730802389975 [Google Scholar]
  46. (2009) Vocabulary knowledge and advanced listening comprehension in English as a foreign language. Studies in Second Language Acquisition, 31(4), 577–607. doi:  10.1017/S0272263109990039
    https://doi.org/10.1017/S0272263109990039 [Google Scholar]
  47. Stewart, J.
    (2014) Do multiple-choice options inflate estimates of vocabulary size on the VST?Language Assessment Quarterly, 11(3), 271–282. doi:  10.1080/15434303.2014.922977
    https://doi.org/10.1080/15434303.2014.922977 [Google Scholar]
  48. Stewart, J., & White, D. A.
    (2011) Estimating guessing effects on the Vocabulary Levels Test for differing degrees of word knowledge. TESOL Quarterly, 45(2), 370–380. doi: 10.5054/tq.201
    https://doi.org/10.5054/tq.201 [Google Scholar]
  49. Stoeckel, T., Bennett, P., & Mclean, S.
    (2016) Is “I Don’t Know “ a Viable Answer Choice on the Vocabulary Size Test?TESOL Quarterly, 50(4), 965–975. doi:  10.1002/tesq.325
    https://doi.org/10.1002/tesq.325 [Google Scholar]
  50. Thorndike, E. L. & Lorge, I.
    (1944) The teacher’s word book of 30 000 words. Teachers College, Columbia University.
    [Google Scholar]
  51. Van Garsse, P.
    (2015) Analyse van de woordenschat op het B1-niveau van Quartier Latin 4 (Unpublished MA thesis). University of Leuven.
  52. Van Houtven, T., Peters, E., & Van den Branden, K.
    (2013) Analyzing student teachers’ academic literacy needs: A qualitative analysis of Flemish first-year teacher trainees’ needs. Language Learning in Higher Education, 2(2), 267–292. doi:  10.1515/cercles‑2012‑0015
    https://doi.org/10.1515/cercles-2012-0015 [Google Scholar]
  53. Webb, S., & Rodgers, M.
    (2009a) Vocabulary demands of television programs. Language Learning, 59(2), 335–366. doi: 10.1111/j.1467‑9922.2009.00509.x/full
    https://doi.org/10.1111/j.1467-9922.2009.00509.x/full [Google Scholar]
  54. Webb, S., & Rodgers, M. P. H.
    (2009b) The lexical coverage of movies. Applied Linguistics, 30(3), 407–427. doi:  10.1093/applin/amp010
    https://doi.org/10.1093/applin/amp010 [Google Scholar]
  55. Webb, S., & Sasao, Y.
    (2013) New directions in vocabulary testing. RELC Journal, 44(3), 263–277. doi:  10.1177/0033688213500582
    https://doi.org/10.1177/0033688213500582 [Google Scholar]
  56. Webb, S., Sasao, Y., & Ballance, O.
    (2017) The updated vocabulary levels test: Developing and validating two new forms of the VLT. ITL – International Journal of Applied Linguistics, 168(2), 33–69. doi:  10.1075/itl.168.1.02web
    https://doi.org/10.1075/itl.168.1.02web [Google Scholar]
  57. Wesche, M., & Paribakht, T. S.
    (1996) Assessing second language vocabulary knowledge: Depth versus breadth. Canadian Modern Language Review, 53(1), 13–40. 10.3138/cmlr.53.1.13
    https://doi.org/10.3138/cmlr.53.1.13 [Google Scholar]
  58. West, M.
    (1953) A General Service List of English Words. London: Longman, Green & Co.
    [Google Scholar]
  59. Zhang, X.
    (2013) The “I don’t Know” option in the Vocabulary Size Test. TESOL Quarterly, 47(4), 790–811. doi:  10.1002/tesq.98
    https://doi.org/10.1002/tesq.98 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/itl.17029.pet
Loading
/content/journals/10.1075/itl.17029.pet
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): English , French , frequency , vocabulary knowledge , vocabulary levels and vocabulary test
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error