1887
  1. Home
  2. e-Journals
  3. ITL - International Journal of Applied Linguistics
  4. Online First Articles
  5. Online First Article
image of The effect of test format on productive recall of derivatives
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This study investigated the extent to which two recall test formats – contextualized and decontextualized tests – affected productive recall of derivatives, and how the effects of token frequencies of derivatives and L2 receptive vocabulary knowledge on recalling derivatives was moderated by test format. Mixed effects logistic regression models examined the derivatives elicited from L1 ( = 21) and L2 English speakers’ ( = 107) on the two recall tests. Results indicated that contextual cues significantly facilitated recalling derivatives, while such facilitative effects were larger for native speakers and L2 learners with greater vocabulary knowledge. Furthermore, token frequency affected the responses on the decontextualized test to a greater degree compared to the contextualized test. Results suggest that test format influences test-takers’ ability to recall knowledge to produce derivatives.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/itl.23002.iwa
2023-12-12
2024-10-12

  • From This Site

    /content/journals/10.1075/itl.23002.iwa
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Aviad-Levitzky, T., Laufer, B., & Goldstein, Z.
    (2019) The new computer adaptive test of size and strength (CATSS): Development and validation. Language Assessment Quarterly, (), –. 10.1080/15434303.2019.1649409
     https://doi.org/10.1080/15434303.2019.1649409 [Google Scholar]
  2. Bates, D., Mächler, M., Bolker, B. M., & Walker, S. C.
    (2015) Fitting linear mixed-effects models using lme4. Journal of Statistical Software, (), –. 10.18637/jss.v067.i01
     https://doi.org/10.18637/jss.v067.i01 [Google Scholar]
  3. Barclay, J. R., Bransford, J. D., Franks, J. J., McCarrell, N. S., & Nitsch, K.
    (1974) Comprehension and semantic flexibility. Journal of Verbal Learning and Verbal Behavior, (), –. 10.1016/S0022‑5371(74)80024‑1
     https://doi.org/10.1016/S0022-5371(74)80024-1 [Google Scholar]
  4. Berk, R. A.
    (2004) Regression Analysis: A Constructive Critique. Sage. 10.4135/9781483348834
     https://doi.org/10.4135/9781483348834 [Google Scholar]
  5. Brezina, V., & Gablasova, D.
    (2015) Is there a core general vocabulary? Introducing the new general service list. Applied Linguistics, (), –. 10.1093/applin/amt018
     https://doi.org/10.1093/applin/amt018 [Google Scholar]
  6. Brysbaert, M., & Stevens, M.
    (2018) Power analysis and effect size in mixed effects models: A tutorial. Journal of Cognition, ():, –. 10.5334/joc.10
     https://doi.org/10.5334/joc.10 [Google Scholar]
  7. Cheng, L., & DeLuca, C.
    (2011) Voices from test-takers: Further evidence for language assessment validation and use, Educational Assessment, (), –. 10.1080/10627197.2011.584042
     https://doi.org/10.1080/10627197.2011.584042 [Google Scholar]
  8. Clahsen, H., & Neubauer, K.
    (2020) Morphology, frequency, and the processing of derived words in native and non-native speakers. Lingua, (), –. 10.1016/j.lingua.2010.06.007
     https://doi.org/10.1016/j.lingua.2010.06.007 [Google Scholar]
  9. Cobb, T., & Laufer, B.
    (2021) The nuclear word family list: A list of the most frequent family members, including base and affixed words. Language Learning. (), –. publication. 10.1111/lang.12452
     https://doi.org/10.1111/lang.12452 [Google Scholar]
  10. Coxhead, A.
    (2000) A new academic word list. TESOL Quarterly, (), –. 10.2307/3587951
     https://doi.org/10.2307/3587951 [Google Scholar]
  11. Coxhead, A., Nation, I. S. P., & Sim, D.
    (2015) Measuring the vocabulary size of native speakers of English in New Zealand secondary schools. New Zealand Journal of Educational Studies, (), –. 10.1007/s40841‑015‑0002‑3
     https://doi.org/10.1007/s40841-015-0002-3 [Google Scholar]
  12. Crossley, S. A., & Salsbury, T.
    (2010) Using lexical indices to predict produced and not produced words in second language learners. The Mental Lexicon, (), –. 10.1075/ml.5.1.05cro
     https://doi.org/10.1075/ml.5.1.05cro [Google Scholar]
  13. Dang, T. N. Y., & Webb, S.
    (2016) Making an essential word list for beginners. InI. S. P. Nation, Making and using word lists for language learning and testing (pp.–, –). John Benjamins. 10.1075/z.208.15ch15
     https://doi.org/10.1075/z.208.15ch15 [Google Scholar]
  14. Davies, M.
    (2009) The 385+ million word Corpus of Contemporary American English (1990– 2008+): Design, architecture, and linguistic insights. International Journal of Corpus Linguistics, (), –. 10.1075/ijcl.14.2.02dav
     https://doi.org/10.1075/ijcl.14.2.02dav [Google Scholar]
  15. Ellis, N. C.
    (2002) Frequency effects in language processing: A review with implications for theories of implicit and explicit language acquisition. Studies in Second Language Acquisition, (), –. 10.1017/S0272263102002024
     https://doi.org/10.1017/S0272263102002024 [Google Scholar]
  16. Fox, J., & Weisberg, S.
    (2019) An R Companion to Applied Regression (3rd ed.). Sage. https://socialsciences.mcmaster.ca/jfox/Books/Companion/
     [Google Scholar]
  17. González-Fernández, B., & Schmitt, N.
    (2020) Word knowledge: Exploring the relationships and order of acquisition of vocabulary knowledge components. Applied Linguistics, () –. 10.1093/applin/amy057
     https://doi.org/10.1093/applin/amy057 [Google Scholar]
  18. Gries, S. T.
    (2021) (Generalized linear) mixed-effects modeling: A learner corpus example. Language Learning, (), –. 10.1111/lang.12448
     https://doi.org/10.1111/lang.12448 [Google Scholar]
  19. Hartig, F.
    (2020) DHARMa: Residual diagnostics for hierarchical (multi-level/mixed) regression models. (R package version 0.4.1) [Computer software]. https://cran.r-project.org/web/packages/DHARMa/index.html
     [Google Scholar]
  20. Iwaizumi, E. & Webb, S.
    (2021) To what extent does productive derivational knowledge of adult L1 speakers and L2 learners at two educational levels differ?TESOL Journal, (), –. 10.1002/tesj.640
     https://doi.org/10.1002/tesj.640 [Google Scholar]
  21. Iwaizumi, E., & Webb, S.
    (2022) Measuring L1 and L2 productive derivational knowledge: How many derivatives can L1 and L2 learners with differing vocabulary levels produce?TESOL Quarterly, (), –. 10.1002/tesq.3035
     https://doi.org/10.1002/tesq.3035 [Google Scholar]
  22. Iwaizumi, E. & Webb, S.
    (2023) To what extent do learner- and word-related variables affect production of derivatives?Language Learning, (), –. 10.1111/lang.12524
     https://doi.org/10.1111/lang.12524 [Google Scholar]
  23. Ishii, T., & Schmitt, N.
    (2009) Developing an integrated diagnostic test of vocabulary size and depth. RELC Journal, (), –. 10.1177/0033688208101452
     https://doi.org/10.1177/0033688208101452 [Google Scholar]
  24. Kremmel, B.
    (2021) Selling the (word) family silver? A response to Webb’s lemma dilemma Studies in Second Language Studies, (), –. 10.1017/S0272263121000693
     https://doi.org/10.1017/S0272263121000693 [Google Scholar]
  25. Kremmel, B., & Schmitt, N.
    (2016) Interpreting vocabulary test scores: What do various item formats tell us about learners’ ability to employ words?Language Assessment Quarterly, (), –. 10.1080/15434303.2016.1237516
     https://doi.org/10.1080/15434303.2016.1237516 [Google Scholar]
  26. Kyle, K., Crossley, S., & Berger, C.
    (2018) The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0. Behavior Research Methods, (), –. 10.3758/s13428‑017‑0924‑4
     https://doi.org/10.3758/s13428-017-0924-4 [Google Scholar]
  27. Laufer, B.
    (1998) The development of passive and active vocabulary in a second language: Same or different. Applied Linguistics, (), –. 10.1093/applin/19.2.255
     https://doi.org/10.1093/applin/19.2.255 [Google Scholar]
  28. (2023) Understanding L2-derived words in context: Is complete receptive morphological knowledge necessary?Studies in Second Language Acquisition. Advanced online publication. 10.1017/S0272263123000219
     https://doi.org/10.1017/S0272263123000219 [Google Scholar]
  29. Laufer, B., & Aviad-Levitzky, T.
    (2017) What type of vocabulary knowledge predicts reading comprehension: Word meaning recall or word meaning recognition?The Modern Language Journal, (), –. 10.1111/modl.12431
     https://doi.org/10.1111/modl.12431 [Google Scholar]
  30. Laufer, B., & Goldstein, Z.
    (2004) Testing vocabulary knowledge: Size, strength, and computer adaptiveness. Language Learning, (), –. 10.1111/j.0023‑8333.2004.00260.x
     https://doi.org/10.1111/j.0023-8333.2004.00260.x [Google Scholar]
  31. Laufer, B., & Nation, P.
    (1995) Vocabulary size and use: Lexical richness in L2 written production. Applied Linguistics, (), –. 10.1093/applin/16.3.307
     https://doi.org/10.1093/applin/16.3.307 [Google Scholar]
  32. Laufer, B., & Ravenhorst-Kalovski, G. C.
    (2010) Lexical threshold revisited: Lexical text coverage, learners’ vocabulary size and reading comprehension. Reading in a Foreign Language, (), –. hdl.handle.net/10125/66648
     [Google Scholar]
  33. Laufer, B., Webb, S., Kim, S., & Yohanan, B.
    (2021) How well do learners know derived words in a second language? The effect of proficiency, word frequency and type of affix. ILT – International Journal of Applied Linguistics, (), –. 10.1075/itl.20020.lau
     https://doi.org/10.1075/itl.20020.lau [Google Scholar]
  34. Lenth, R. V.
    (2022) emmeans: Estimated marginal means, aka least-squares means. (R package version 1.7.3) [Computer software] https://CRAN.R-project.org/package=emmeans
  35. Leontjev, D., Huhta, A., & Mäntylä, K.
    (2016) Word derivational knowledge and writing proficiency: How do they link?System, , –. 10.1016/j.system.2016.03.013
     https://doi.org/10.1016/j.system.2016.03.013 [Google Scholar]
  36. McCutchen, D., & Stull, S.
    (2015) Morphological awareness and children’s writing: accuracy, error, and invention. Reading and Writing, (), –. 10.1007/s11145‑014‑9524‑1
     https://doi.org/10.1007/s11145-014-9524-1 [Google Scholar]
  37. Miralpeix, I., & Muñoz, C.
    (2018) Receptive vocabulary size and its relationship to EFL language skills, International Review of Applied Linguistics in Language Teaching, (), –. 10.1515/iral‑2017‑0016
     https://doi.org/10.1515/iral-2017-0016 [Google Scholar]
  38. Nation, I. S. P.
    (2006) How large a vocabulary is needed for reading and listening?The Canadian Modern Language Review, (), –. 10.3138/cmlr.63.1.59
     https://doi.org/10.3138/cmlr.63.1.59 [Google Scholar]
  39. Nation, Nation, P., & Beglar, D.
    (2007) A vocabulary size test. The Language Teacher, (), –. www.jalt-publications.org/archive/tlt/2007/07_2007TLT.pdf
     [Google Scholar]
  40. Nation, I. S. P.
    (2012) The BNC/COCA word family list. https://www.wgtn.ac.nz/lals/resources/paul-nations-resources/vocabulary-lists
     [Google Scholar]
  41. (2022) Learning vocabulary in another language (2nd ed.). Cambridge University Press. 10.1017/9781009093873
     https://doi.org/10.1017/9781009093873 [Google Scholar]
  42. Nation, I. S. P., & Webb, S.
    (2011) Researching and Analyzing Vocabulary. Heinle ELT.
     [Google Scholar]
  43. Peters, E.
    (2018) The effect of out-of-class exposure to English language media on learners’ vocabulary knowledge. ITL–International Journal of Applied Linguistics, (), –. 10.1075/itl.00010.pet
     https://doi.org/10.1075/itl.00010.pet [Google Scholar]
  44. Qian, D. D.
    (2005) Demystifying lexical inferencing: The role of aspects of vocabulary knowledge. TESL Canada Journal, (), –. 10.18806/tesl.v22i2.86
     https://doi.org/10.18806/tesl.v22i2.86 [Google Scholar]
  45. (2008) From single words to passages: Contextual effects on predictive power of vocabulary measures for assessing reading performance, Language Assessment Quarterly, (), –, 10.1080/15434300701776138
     https://doi.org/10.1080/15434300701776138 [Google Scholar]
  46. R Core Team
    R Core Team (2022) R: A language and environment for statistical computing. R Foundation for Statistical Computing (Version 4.1.2) [Computer software]. https://www.rproject.org/
     [Google Scholar]
  47. Read, J.
    (2000) Assessing vocabulary. Cambridge University Press. 10.1017/CBO9780511732942
     https://doi.org/10.1017/CBO9780511732942 [Google Scholar]
  48. Sasao, Y., & Webb, S.
    (2017) The word part levels test. Language Teaching Research, (), –. 10.1177/1362168815586083
     https://doi.org/10.1177/1362168815586083 [Google Scholar]
  49. Schmitt, N.
    (2010) Researching vocabulary: A vocabulary research manual. Palgrave Macmillan UK. 10.1057/9780230293977
     https://doi.org/10.1057/9780230293977 [Google Scholar]
  50. Schmitt, N., & Meara, P.
    (1997) Researching vocabulary through a word knowledge framework. Studies in Second Language Acquisition, (), –. 10.1017/S0272263197001022
     https://doi.org/10.1017/S0272263197001022 [Google Scholar]
  51. Schmitt, N., & Zimmerman, C. B.
    (2002) Derivative word forms: What do learners know?TESOL Quarterly, (), –. 10.2307/3588328
     https://doi.org/10.2307/3588328 [Google Scholar]
  52. Snoder, P., & Laufer, B.
    (2023) EFL learners’ receptive knowledge of derived words: The case of Swedish Adolescents. TESOL Quarterly, (), –. 10.1002/tesq.3101
     https://doi.org/10.1002/tesq.3101 [Google Scholar]
  53. Tulving, E., & Thomson, D. M.
    (1973) Encoding specificity and retrieval processes in episodic memory. Psychological Review, (),  – . 10.1037/h0020071
     https://doi.org/10.1037/h0020071 [Google Scholar]
  54. Ullman, M. T.
    (2001) The neural basis of lexicon and grammar in first and second language: The declarative/procedural model. Bilingualism: Language and Cognition, (), –. 10.1017/S1366728901000220
     https://doi.org/10.1017/S1366728901000220 [Google Scholar]
  55. Watanabe, Y.
    (1997) Input, intake, and retention: Effects of increased processing on incidental learning of foreign language vocabulary. Studies in Second Language Acquisition, (), –. 10.1017/S027226319700301X
     https://doi.org/10.1017/S027226319700301X [Google Scholar]
  56. Webb, S.
    (2005) Receptive and productive vocabulary learning: The effects of reading and writing on word knowledge. Studies in Second Language Acquisition, (), –. 10.1017/S0272263105050023
     https://doi.org/10.1017/S0272263105050023 [Google Scholar]
  57. (2008) The effects of context on incidental vocabulary learning. Reading in a Foreign Language, (), –. hdl.handle.net/10125/66826
     [Google Scholar]
  58. (2018) Advanced lexical development. InMalovrh, P. A. & A. G. Benati (Eds). The handbook of advanced proficiency in second language acquisition (pp.–). John Wiley & Sons, Inc. 10.1002/9781119261650.ch21
     https://doi.org/10.1002/9781119261650.ch21 [Google Scholar]
  59. (2021) The lemma dilemma: How should words be operationalized in research and pedagogy?Studies in Second Language Acquisition, (), –. 10.1017/S0272263121000784
     https://doi.org/10.1017/S0272263121000784 [Google Scholar]
  60. Webb, S. & Chang, A. C.-S.
    (2015) How does prior word knowledge affect vocabulary learning progress in an extensive reading program?Studies in Second Language Acquisition, (), –. 10.1017/S0272263121000784
     https://doi.org/10.1017/S0272263121000784 [Google Scholar]
  61. Webb, S., Sasao, Y., & Ballance, O.
    (2017) The updated vocabulary levels test: Developing and validating two new forms of the VLT. ITL – International Journal of Applied Linguistics, (), –. 10.1075/itl.168.1.02web
     https://doi.org/10.1075/itl.168.1.02web [Google Scholar]
/content/journals/10.1075/itl.23002.iwa
Loading
The effect of test format on productive recall of derivatives
John Benjamins ; https://doi.org/10.1075/itl.23002.iwa
/content/journals/10.1075/itl.23002.iwa
/content/journals/10.1075/itl.23002.iwa
Loading

Data & Media loading...

  • Article Type: Research Article
Keywords: testing vocabulary knowledge ; receptive vocabulary knowledge ; test format effects ; frequency effects ; productive derivational knowledge

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error