1887
image of Measuring the visual in audio-visual input
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This exploratory study investigates the effects of imagery on word learning through audio-visual input. A total of 82 adolescent EFL learners were exposed to 8 episodes of a TV series under four conditions, depending on the language of the on-screen text (L1 or L2) and whether they were pre-taught target words or not. The effects of co-occurrence of the word with its image, and the image time on screen (ITOS) were explored, alongside frequency, proficiency, and learning condition variables. Results showed that both image-related variables and frequency predicted word-form learning, while only ITOS predicted word-meaning recall, with a longer exposure to image associated to higher gains, suggesting that, at this age and proficiency level, the images associated with the words can be conducive to learning.

Loading

Article metrics loading...

/content/journals/10.1075/itl.22019.puj
2023-03-06
2023-03-30
Loading full text...

Full text loading...

References

  1. Avello, D. & Muñoz, C.
    (forthcoming). The use of captioned-video viewing to support the development of L2 reading skills. Proceedings of the fifth ELTRIA Conference, Barcelona.
    [Google Scholar]
  2. Baltova, I.
    (1994) The impact of video on the comprehension skills of core French students. Canadian Modern Language Review, (), –. 10.3138/cmlr.50.3.507
    https://doi.org/10.3138/cmlr.50.3.507 [Google Scholar]
  3. Bianchi, F., & Ciabattoni, T.
    (2008) Captions and subtitles in EFL learning: an investigative study in a comprehensive computer environment. InBaldry, A., Pavesi, M., & Taylor Torsello, C. (Eds.) From didactas to ecolingua: An ongoing research project on translation and corpus linguistics (pp.–). Trieste: Edizioni Università di Trieste. hdl.handle.net/10077/2848
    [Google Scholar]
  4. Boers, F.
    (2018) Intentional versus incidental learning. The TESOL Encyclopedia of English Language Teaching, –. 10.1002/9781118784235.eelt0074
    https://doi.org/10.1002/9781118784235.eelt0074 [Google Scholar]
  5. Brown, R., Waring, R., & Donkaewbua, S.
    (2008) Incidental vocabulary acquisition from reading, reading-while-listening, and listening to stories. Reading in a foreign language, (), –.
    [Google Scholar]
  6. Brysbaert, M., Warriner, A. B., & Kuperman, V.
    (2014) Concreteness ratings for 40 thousand generally known English word lemmas. Behavior research methods, (), –. 10.3758/s13428‑013‑0403‑5
    https://doi.org/10.3758/s13428-013-0403-5 [Google Scholar]
  7. Chai, J., & Erlam, R.
    (2008) The effect and the influence of the use of video and captions on second language learning. New Zealand Studies in Applied Linguistics, (), .
    [Google Scholar]
  8. Charles, T., & Trenkic, D.
    (2015) Speech segmentation in a second language: The role of bimodal input. InGambier, Y., Caimi, A., & Mariotti, C. (Eds.) Subtitles and language learning: Principles, strategies and practical experiences (pp.–). Bern: Peter Lang.
    [Google Scholar]
  9. Chen, Y. R., Liu, Y. T., & Todd, A. G.
    (2018) Transient but effective? Captioning and adolescent EFL learners’ spoken vocabulary acquisition. English Teaching & Learning, , –. 10.1007/s42321‑018‑0002‑8
    https://doi.org/10.1007/s42321-018-0002-8 [Google Scholar]
  10. Danan, M.
    (2004) Captioning and subtitling: undervalued language learning strategies. Meta: Journal Des Traducteurs, (), –. 10.7202/009021ar
    https://doi.org/10.7202/009021ar [Google Scholar]
  11. Deconinck, J., Boers, F., & Eyckmans, J.
    (2017) ‘Does the form of this word fit its meaning?’ The effect of learner-generated mapping elaborations on L2 word recall. Language teaching research, (), –. 10.1177/1362168815614048
    https://doi.org/10.1177/1362168815614048 [Google Scholar]
  12. Douglas Fir Group
    Douglas Fir Group (2016) A transdisciplinary framework for SLA in a multilingual world. The Modern Language Journal, (), –. 10.1111/modl.12301
    https://doi.org/10.1111/modl.12301 [Google Scholar]
  13. Durbahn, M., Rodgers, M., & Peters, E.
    (2020) The relationship between vocabulary and viewing comprehension. System, . 10.1016/j.system.2019.102166
    https://doi.org/10.1016/j.system.2019.102166 [Google Scholar]
  14. Elley, W. B.
    (1989) Vocabulary acquisition from listening to stories. Reading Research Quarterly(), –. https://www.jstor.org/stable/747863. 10.2307/747863
    https://doi.org/10.2307/747863 [Google Scholar]
  15. Feng, Y., & Webb, S.
    (2020) Learning vocabulary through reading, listening, and viewing: Which mode of input is most effective?Studies in Second Language Acquisition, (), –. 10.1017/S0272263119000494
    https://doi.org/10.1017/S0272263119000494 [Google Scholar]
  16. Gullberg, M., De Bot, K., & Volterra, V.
    (2008) Gestures and some key issues in the study of language development. Gestures(), –. 10.1075/gest.8.2.03gul
    https://doi.org/10.1075/gest.8.2.03gul [Google Scholar]
  17. Hasan, A.
    (2000) Learners’ perceptions of listening comprehension problems. Language, Culture and Curriculum, (), –. 10.1080/07908310008666595
    https://doi.org/10.1080/07908310008666595 [Google Scholar]
  18. Horst, M., Cobb, T., & Meara, P.
    (1998) Beyond a clockwork orange: Acquiring second language vocabulary through reading. Reading in a Foreign Language(), –.
    [Google Scholar]
  19. Hulstijn, J. H.
    (2003) Incidental and Intentional Learning. InDoughty, C. & Long, M. H. (Eds.), The handbook of second language acquisition (Vol., pp.–). MA: Blackwell. 10.1002/9780470756492.ch12
    https://doi.org/10.1002/9780470756492.ch12 [Google Scholar]
  20. (2013) Incidental learning in second language acquisition. InChapelle, C. A. (Ed.) The encyclopedia of applied linguistics (Vol., pp.–). Chichester: Wiley-Blackwell. 10.1002/9781405198431
    https://doi.org/10.1002/9781405198431 [Google Scholar]
  21. Jelani, N. A., & Boers, F.
    (2018) Examining incidental vocabulary acquisition from captioned video: Does test modality matter?ITL-International Journal of Applied Linguistics, (), –. 10.1075/itl.00011.jel
    https://doi.org/10.1075/itl.00011.jel [Google Scholar]
  22. Jones, L.
    (2004) Testing L2 vocabulary recognition and recall using pictorial and written test items. Language learning & technology(), –. ISSN1094-3501
    [Google Scholar]
  23. Jones, L., & Plass, J.
    (2002) Supporting listening comprehension and vocabulary acquisition in French with multimedia annotations. The Modern Language Journal, (), –. 10.1111/1540‑4781.00160
    https://doi.org/10.1111/1540-4781.00160 [Google Scholar]
  24. Khan, N., Kasdar, J., Melvin, M., Blomquist, R., Huang, E., & McEwen, J.
    (2015) Fresh off the Boat [TV series] Los Angeles, CA: ABC.
    [Google Scholar]
  25. Krashen, S. D.
    (2003) Explorations in language acquisition and use. Portsmouth, NH: Heinemann. ISBN: 0-325-00554-0
    [Google Scholar]
  26. Lee, S.
    (2007) Effects of textual enhancement and topic familiarity on Korean EFL students’ reading comprehension and learning of passive form. Language Learning, (), –. 10.1111/j.1467‑9922.2007.00400.x
    https://doi.org/10.1111/j.1467-9922.2007.00400.x [Google Scholar]
  27. Lindgren, E., & Muñoz, C.
    (2013) The influence of exposure, parents, and linguistic distance on young European learners’ foreign language comprehension. International Journal of Multilingualism, (), –. 10.1080/14790718.2012.679275
    https://doi.org/10.1080/14790718.2012.679275 [Google Scholar]
  28. Maleki, A., & Safaee Rad, M.
    (2011) The effect of visual and textual accompaniments to verbal stimuli on the listening comprehension test performance of Iranian high and low proficient EFL learners. Theory and Practice in Language Studies, (), –. 10.4304/tpls.1.1.28‑36
    https://doi.org/10.4304/tpls.1.1.28-36 [Google Scholar]
  29. Markham, P.
    (1999) Captioned videotapes and second-language listening word recognition. Foreign Language Annals, (), –. 10.1111/j.1944‑9720.1999.tb01344.x
    https://doi.org/10.1111/j.1944-9720.1999.tb01344.x [Google Scholar]
  30. Mayer, R.
    (2014) The Cambridge handbook of multimedia learning. Cambridge: Cambridge University Press. 10.1017/CBO9781139547369
    https://doi.org/10.1017/CBO9781139547369 [Google Scholar]
  31. Meara, P., & Milton, J.
    (2003) X_Lex: the Swansea levels test. Berkshire: Express Publishing.
    [Google Scholar]
  32. Miralpeix, I.
    (2012, March). X_Lex and Y_Lex: A validation study. Paper presented at the22nd Lexical Studies Conference, Newtown, UK.
    [Google Scholar]
  33. Montero Perez, M.
    (2019) Pre-learning vocabulary before viewing captioned video: an eye-tracking study. The Language Learning Journal, (), –. 10.1080/09571736.2019.1638623
    https://doi.org/10.1080/09571736.2019.1638623 [Google Scholar]
  34. Montero Perez, M., Peters, E., & Desmet, P.
    (2018) Vocabulary learning through viewing video: the effect of two enhancement techniques. Computer Assisted Language Learning, (), –. 10.1080/09588221.2017.1375960
    https://doi.org/10.1080/09588221.2017.1375960 [Google Scholar]
  35. Montero Perez, M., Peters, E., Clarebout, G., & Desmet, P.
    (2014) Effects of captioning on video comprehension and incidental vocabulary learning. Language Learning and Technology, (), –. 10125/44357
    https://doi.org/10125/44357 [Google Scholar]
  36. Muñoz, C., Pujadas, G., & Pattemore, A.
    (2023) Audio-visual input for learning L2 vocabulary and grammatical constructions. Second Language Research(), –. 10.1177/02676583211015797
    https://doi.org/10.1177/02676583211015797 [Google Scholar]
  37. Naghizadeh, M., & Darabi, T.
    (2015) The impact of bimodal, Persian and no-subtitle movies on Iranian EFL learners’ L2 vocabulary learning. Journal of Applied Linguistics and Language Research, (), –. 10.18052/www.scipress.com/ILSHS.55.111
    https://doi.org/10.18052/www.scipress.com/ILSHS.55.111 [Google Scholar]
  38. Nation, P.
    (2015) Principles guiding vocabulary learning through extensive reading. Reading in a Foreign Language(): –.
    [Google Scholar]
  39. Nation, P., & Heatley, A.
    (2002) Range: A program for the analysis of vocabulary in texts [software]. Retrieved from: https://www.victoria.ac.nz/lals/about/staff/paul-nation
  40. Pellicer-Sánchez, A., & Schmitt, N.
    (2010) Incidental Vocabulary Acquisition from an Authentic Novel: Do “Things Fall Apart”?Reading in a Foreign Language, (), –.
    [Google Scholar]
  41. Peters, E.
    (2019) The effect of imagery and on-screen text on foreign language vocabulary learning from audiovisual input. TESOL Quarterly, (), –. 10.1002/tesq.531
    https://doi.org/10.1002/tesq.531 [Google Scholar]
  42. Peters, E., & Webb, S.
    (2018) Incidental vocabulary acquisition through viewing L2 television and factors that affect learning. Studies in Second Language Acquisition, (), –. 10.1017/S0272263117000407
    https://doi.org/10.1017/S0272263117000407 [Google Scholar]
  43. Peters, E., Heynen, E., & Puimège, E.
    (2016) Learning Vocabulary through Audiovisual Input: The Differential Effect of L1 Subtitles and Captions. System, –. 10.1016/j.system.2016.10.002
    https://doi.org/10.1016/j.system.2016.10.002 [Google Scholar]
  44. Pujadas, G.
    (2019) Language learning through extensive TV viewing: A study with adolescent EFL learners (Unpublished doctoral dissertation). University of Barcelona.
  45. Pujadas, G., & Muñoz, C.
    (2018) What words do we learn better through TV series? The effects of age, proficiency and type of instruction. Paper presented at theSecond Language Research Forum, Montreal, Canada.
    [Google Scholar]
  46. (2019) Extensive viewing of captioned and subtitled TV series: A study of L2 vocabulary learning by adolescents. The Language Learning Journal, (), –. 10.1080/09571736.2019.1616806
    https://doi.org/10.1080/09571736.2019.1616806 [Google Scholar]
  47. (2020) Examining Adolescent EFL leaners’ TV viewing comprehension through captions and subtitles. Studies in Second Language Acquisition, (), –. 10.1017/S0272263120000042
    https://doi.org/10.1017/S0272263120000042 [Google Scholar]
  48. Robinson, P., Mackey, A., Gass, S. M., & Schmidt, R.
    (2012) Attention and awareness in second language acquisition. InGass, S. M., & Mackey, A. (Eds.) The Routledge Handbook of Second Language Acquisition (pp.–).
    [Google Scholar]
  49. Rodgers, M. P. H.
    (2013) English language learning through viewing television: An investigation of comprehension, incidental vocabulary acquisition, lexical coverage, attitudes, and captions (Unpublished doctoral dissertation). Victoria University of Wellington.
  50. (2016) Extensive listening and viewing: The benefits of audiobooks and television. The European Journal of Applied Linguistics and TEFL, (), –.
    [Google Scholar]
  51. (2018) The images in television programs and the potential for learning unknown words: The relationship between on-screen imagery and vocabulary. ITL – International Journal of Applied Linguistics(), –. 10.1075/itl.00012.rod
    https://doi.org/10.1075/itl.00012.rod [Google Scholar]
  52. Rodgers, M. P. H., & Webb, S.
    (2011) Narrow viewing: The vocabulary in related television programs. TESOL Quarterly, (), –. 10.5054/tq.2011.268062
    https://doi.org/10.5054/tq.2011.268062 [Google Scholar]
  53. (2020) Incidental vocabulary learning through viewing television. ITL – International Journal of Applied Linguistics, (), –. 10.1075/itl.18034.rod
    https://doi.org/10.1075/itl.18034.rod [Google Scholar]
  54. Suárez, M. D. M., Gilabert, R., & Moskvina, N.
    (2021) The mediating role of vocabulary size, working memory, attention and inhibition in early vocabulary learning under different TV genres: An exploratory study. TESOL Journal, (), e637. 10.1002/tesj.637
    https://doi.org/10.1002/tesj.637 [Google Scholar]
  55. Sydorenko, T.
    (2010) Modality of input and vocabulary acquisition. Language Learning and Technology, (), –. 10125/44214
    https://doi.org/10125/44214 [Google Scholar]
  56. Uchihara, T., Webb, S., & Yanagisawa, A.
    (2019) The Effects of Repetition on Incidental Vocabulary Learning: A Meta-Analysis of Correlational Studies. Language Learning, (), –. 10.1111/lang.12343
    https://doi.org/10.1111/lang.12343 [Google Scholar]
  57. van Zeeland, H., & Schmitt, N.
    (2013) Incidental vocabulary acquisition through L2 listening: A dimensions approach. System, (), –. 10.1016/j.system.2013.07.012
    https://doi.org/10.1016/j.system.2013.07.012 [Google Scholar]
  58. Vandergrift, L.
    (2007) Recent developments in second and foreign language listening comprehension research. Language Teaching, (), –. 10.1017/S0261444807004338
    https://doi.org/10.1017/S0261444807004338 [Google Scholar]
  59. Vanderplank, R.
    (2010) Déjà vu? A decade of research on language laboratories, television and video in language learning. Language Teaching(), –. 10.1017/S0261444809990267
    https://doi.org/10.1017/S0261444809990267 [Google Scholar]
  60. Vidal, K.
    (2011) A comparison of the effects of reading and listening on incidental vocabulary acquisition. Language Learning, (), –. 10.1111/j.1467‑9922.2010.00593.x
    https://doi.org/10.1111/j.1467-9922.2010.00593.x [Google Scholar]
  61. Webb, S.
    (2007) The effects of repetition on vocabulary knowledge. Applied Linguistics, (), –. 10.1093/applin/aml048
    https://doi.org/10.1093/applin/aml048 [Google Scholar]
  62. (2010a) Pre-learning low-frequency vocabulary in second language television programmes. Language Teaching Research, (), –. 10.1177/1362168810375371
    https://doi.org/10.1177/1362168810375371 [Google Scholar]
  63. (2010b) Using Glossaries to Increase the Lexical Coverage of Television Programs. Reading in a Foreign Language, (), –.
    [Google Scholar]
  64. Webb, S., & Chang, A. C.
    (2015) Second language vocabulary learning through extensive reading with audio support: How do frequency and distribution of occurrence affect learning?Language Teaching Research, (), –. 10.1177/1362168814559800
    https://doi.org/10.1177/1362168814559800 [Google Scholar]
  65. Webb, S., & Nation, P.
    (2017) How vocabulary is learned. Oxford University Press.
    [Google Scholar]
  66. Webb, S., & Rodgers, M.
    (2009a) Vocabulary demands of television programs. Language Learning, (), –. 10.1111/j.1467‑9922.2009.00509.x
    https://doi.org/10.1111/j.1467-9922.2009.00509.x [Google Scholar]
  67. (2009b) The lexical coverage of movies. Applied Linguistics, (), –. 10.1093/applin/amp010
    https://doi.org/10.1093/applin/amp010 [Google Scholar]
  68. Winke, P., Gass, S., & Sydorenko, T.
    (2010) The effects of captioning videos used for foreign language listening activities. Language Learning and Technology, (), –. 10125/44203
    https://doi.org/10125/44203 [Google Scholar]
  69. Yang, H. Y.
    (2014) The effects of advance organizers and subtitles on EFL learners’ listening comprehension skills. Calico Journal, (), –. 10.11139/cj.31.3.345‑373
    https://doi.org/10.11139/cj.31.3.345-373 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/itl.22019.puj
Loading
/content/journals/10.1075/itl.22019.puj
Loading

Data & Media loading...

  • Article Type: Research Article
Keywords: imagery ; vocabulary learning ; TV viewing ; frequency ; adolescents
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error