1887
  1. Home
  2. e-Journals
  3. International Journal of Chinese Linguistics
  4. Volume 12, Issue 2
  5. Article
Volume 12, Issue 2
  • ISSN 2213-8706
  • E-ISSN: 2213-8714
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Non-cognitive factors, such as language input delivered through multimodal channels, may influence second and foreign language learning performance and learner motivation. A substantial body of research has demonstrated the facilitative role of visual aids, such as pictures and videos (Ramezanali & Faez, 2019), as well as bodily movements and gestures (Macedonia & Knösche, 2011), in vocabulary learning. These studies on language embodiment also highlight learners’ general preference for multimodal instructional materials (Lin & Yu, 2017). However, most existing research has focused on languages with alphabetic scripts, leaving open questions about how multimodal input affects learning outcomes and motivation in languages with non-alphabetic writing systems. This study addresses this gap by investigating Mandarin Chinese, one of the most widely spoken languages in the world with a logographic writing system, among adult novice learners in three instructional conditions: a traditional pinyin-only group, a picture-enriched group, and a gesture-enriched group. Preliminary findings from a sample of 20 participants reveal that participants in the picture-enriched ( = 6) demonstrated significantly greater gains in motivation from pre- to post-learning compared to those in the pinyin-only group ( = 8) (.05), with the gesture-enriched group ( = 6) showing marginal gains ( = .08). However, there are no significant differences across three learning conditions in word learning outcomes. These results align with previous findings on the motivational benefits of multimodal instruction and contribute to our understanding of how such approaches might be effectively integrated into L2 pedagogy for logographic scripts.

© 2025 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/ijchl.00039.hua
2025-10-06
2025-11-13

  • From This Site

    /content/journals/10.1075/ijchl.00039.hua
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Andrä, C., Mathias, B., Schwager, A., Macedonia, M., & von Kriegstein, K.
    (2020) Learning foreign language vocabulary with gestures and pictures enhances vocabulary memory for several months post-learning in eight-year-old school children. Educational Psychology Review321, 815–850. 10.1007/s10648‑020‑09527‑z
     https://doi.org/10.1007/s10648-020-09527-z [Google Scholar]
  2. Blanco, C.
    (2024, December1). 2024 Duolingo language report: What languages came out on top in 2024? Can you guess what’s changed?Duolingo Blog. https://blog.duolingo.com/2024-duolingo-language-report/
     [Google Scholar]
  3. Chan, J., Woore, R., Molway, L., & Mutton, T.
    (2022) Learning and teaching Chinese as a foreign language: A scoping review. Review of Education, 10(3), e3370. 10.1002/rev3.3370
     https://doi.org/10.1002/rev3.3370 [Google Scholar]
  4. Colenbrander, D., Miles, K. P., & Ricketts, J.
    (2019) To see or not to see: How does seeing spellings support vocabulary learning?. Language, Speech, and Hearing Services in Schools, 50(4), 609–628. 10.1044/2019_LSHSS‑VOIA‑18‑0135
     https://doi.org/10.1044/2019_LSHSS-VOIA-18-0135 [Google Scholar]
  5. Deci, E. L., Eghrari, H., Patrick, B. C., & Leone, D. R.
    (1994) Facilitating internalization: The self-determination theory perspective. Journal of personality, 62(1), 119–142. 10.1111/j.1467‑6494.1994.tb00797.x
     https://doi.org/10.1111/j.1467-6494.1994.tb00797.x [Google Scholar]
  6. de Groot, A. M., & Keijzer, R.
    (2000) What is hard to learn is easy to forget: The roles of word concreteness, cognate status, and word frequency in foreign-language vocabulary learning and forgetting. Language Learning, 50(1), 1–56. 10.1111/0023‑8333.00110
     https://doi.org/10.1111/0023-8333.00110 [Google Scholar]
  7. Dewaele, J.-M., & Alfawzan, M.
    (2018) Does the effect of enjoyment outweigh that of anxiety in foreign language performance?Studies in Second Language Learning and Teaching, 81, 21–25. 10.14746/ssllt.2018.8.1.2
     https://doi.org/10.14746/ssllt.2018.8.1.2 [Google Scholar]
  8. Dewaele, J. M., & MacIntyre, P. D.
    (2014) The two faces of Janus? Anxiety and enjoyment in the foreign language classroom. Studies in second language learning and teaching, 4(2), 237–274. 10.14746/ssllt.2014.4.2.5
     https://doi.org/10.14746/ssllt.2014.4.2.5 [Google Scholar]
  9. Dewaele, J.-M., & Proietti Ergün, A. L.
    (2020) How different are the relations between enjoyment, anxiety, attitudes/motivation and course marks in pupils’ Italian and English as foreign languages?Journal of the European Second Language Association, 4(1), 45–57. 10.22599/jesla.65
     https://doi.org/10.22599/jesla.65 [Google Scholar]
  10. Dörnyei, Z.
    (1998) Motivation in second and foreign language learning. Language Teaching, 31(3), 117–135. 10.1017/S026144480001315X
     https://doi.org/10.1017/S026144480001315X [Google Scholar]
  11. Dressman, D.
    (2019) Multimodality and language learning. InM. Dressman & R. W. Sadler (Eds.), The handbook of informal language learning (pp. 39–55). Wiley-Blackwell. 10.1002/9781119472384.ch3
     https://doi.org/10.1002/9781119472384.ch3 [Google Scholar]
  12. Er, S.
    (2013) Using total physical response method in early childhood foreign language teaching environments. Procedia-Social and Behavioral Sciences, 931, 1766–1768. 10.1016/j.sbspro.2013.10.113
     https://doi.org/10.1016/j.sbspro.2013.10.113 [Google Scholar]
  13. Everson, M. E.
    (1998) Word recognition among learners of Chinese as a foreign language: Investigating the relationship between naming and knowing. The Modern Language Journal, 82(2), 194–204. 10.1111/j.1540‑4781.1998.tb01192.x
     https://doi.org/10.1111/j.1540-4781.1998.tb01192.x [Google Scholar]
  14. Gardner, R. C.
    (2004) Attitudes/Motivation Test Battery: International AMTB research project (English version). Canada: The University of Western Ontario. https://publish.uwo.ca/~gardner/docs/englishamtb.pdf
     [Google Scholar]
  15. International Center for Language Studies (ICLS)
    International Center for Language Studies (ICLS) (2024, August20). Most spoken languages in the world. International Center for Language Studies. https://www.icls.edu/blog/most-spoken-languages-in-the-world
     [Google Scholar]
  16. Jaeggi, S. M., Buschkuehl, M., Perrig, W. J., & Meier, B.
    (2010) The concurrent validity of the N-back task as a working memory measure. Memory, 18(4), 394–412. 10.1080/09658211003702171
     https://doi.org/10.1080/09658211003702171 [Google Scholar]
  17. Jin, Y., & Zhang, L. J.
    (2018) The dimensions of foreign classroom enjoyment and their effect on foreign language achievement. International Journal of Bilingual Education and Bilingualism, 24(7), 948–962. 10.1080/13670050.2018.1526253
     https://doi.org/10.1080/13670050.2018.1526253 [Google Scholar]
  18. Lee, W. J., Huang, C. W., Wu, C. J., Huang, S. T., & Chen, G. D.
    (2012, July). The effects of using embodied interactions to improve learning performance [Conference presentation]. 2012 IEEE 12th International Conference on Advanced Learning Technologies, Rome, Italy. 10.1109/ICALT.2012.104
     https://doi.org/10.1109/ICALT.2012.104 [Google Scholar]
  19. Li, W., Yu, J., Zhang, Z., & Liu, X.
    (2022) Dual coding or cognitive load? Exploring the effect of multimodal input on English as a foreign language learners’ vocabulary learning. Frontiers in Psychology, 131, 834706. 10.3389/fpsyg.2022.834706
     https://doi.org/10.3389/fpsyg.2022.834706 [Google Scholar]
  20. Lin, C.
    (2018) Motivation in U.S learners of Mandarin as a foreign and heritage language [Doctoral dissertation, University of Hawaiʻi at Mānoa]. ScholarSpace.
  21. Lin, C. C., & Yu, Y. C.
    (2017) Effects of presentation modes on mobile-assisted vocabulary learning and cognitive load. Interactive Learning Environments, 25(4), 528–542. 10.1080/10494820.2016.1155160
     https://doi.org/10.1080/10494820.2016.1155160 [Google Scholar]
  22. Lin, D., Chen, G., Liu, Y., Liu, J., Pan, J., & Mo, L.
    (2018) Tracking the eye movement of four years old children learning Chinese words. Journal of Psycholinguistic Research, 47(1), 79–93. 10.1007/s10936‑017‑9515‑x
     https://doi.org/10.1007/s10936-017-9515-x [Google Scholar]
  23. Lin, Y.-J., & Wang, H.-C.
    (2021) Using virtual reality to facilitate learners’ creative self-efficacy and intrinsic motivation in an EFL classroom. Education and Information Technologies, 26(4), 4487–4505. 10.1007/s10639‑021‑10472‑9
     https://doi.org/10.1007/s10639-021-10472-9 [Google Scholar]
  24. Liu, H. C.
    (2021) Using eye-tracking technology to explore the impact of instructional multimedia on CFL learners’ Chinese character recognition. The Asia-Pacific Education Researcher, 30(1), 33–46. 10.1007/s40299‑020‑00512‑2
     https://doi.org/10.1007/s40299-020-00512-2 [Google Scholar]
  25. Lu, M.
    (2011, October14–16). Chinese character learning: Using embodiment in initial stage [Conference presentation]. American Association for Chinese Studies Conference2011, Philadelphia, PA, United States. https://aacs.ccny.cuny.edu/2011conference/Papers2011.htm
     [Google Scholar]
  26. Macedonia, M., & Knösche, T. R.
    (2011) Body in mind: How gestures empower foreign language learning. Mind, Brain, and Education, 5(4), 196–211. 10.1111/j.1751‑228X.2011.01129.x
     https://doi.org/10.1111/j.1751-228X.2011.01129.x [Google Scholar]
  27. Martín-Luengo, B., Hu, Z., Cadavid, S., & Luna, K.
    (2023) Do pictures influence memory and metamemory in Chinese vocabulary learning? Evidence from Russian and Colombian learners. Plos One, 18(11), e0286824. 10.1371/journal.pone.0286824
     https://doi.org/10.1371/journal.pone.0286824 [Google Scholar]
  28. Martin, K. I., & Ellis, N. C.
    (2012) The roles of phonological short-term memory and working memory in L2 grammar and vocabulary learning. Studies in Second Language Acquisition, 34(3), 379–413. 10.1017/S0272263112000125
     https://doi.org/10.1017/S0272263112000125 [Google Scholar]
  29. Mathias, B., Andrä, C., Schwager, A., Macedonia, M., & von Kriegstein, K.
    (2022) Twelve-and fourteen-year-old school children differentially benefit from sensorimotor-and multisensory-enriched vocabulary training. Educational Psychology Review, 34(3), 1739–1770. 10.1007/s10648‑021‑09648‑z
     https://doi.org/10.1007/s10648-021-09648-z [Google Scholar]
  30. Mayer, K. M., Yildiz, I. B., Macedonia, M., & von Kriegstein, K.
    (2015) Visual and motor cortices differentially support the translation of foreign language words. Current Biology, 25(4), 530–535. 10.1016/j.cub.2014.11.068
     https://doi.org/10.1016/j.cub.2014.11.068 [Google Scholar]
  31. McBride, C. A.
    (2016) Is Chinese special? Four aspects of Chinese literacy acquisition that might distinguish learning Chinese from learning alphabetic orthographies. Educational Psychology Review, 281, 523–549. 10.1007/s10648‑015‑9318‑2
     https://doi.org/10.1007/s10648-015-9318-2 [Google Scholar]
  32. Nathan, M. J., Walkington, C., Boncoddo, R., Pier, E., Williams, C. C., & Alibali, M. W.
    (2014) Actions speak louder with words: The roles of action and pedagogical language for grounding mathematical proof. Learning and Instruction, 331, 182–193. 10.1016/j.learninstruc.2014.07.001
     https://doi.org/10.1016/j.learninstruc.2014.07.001 [Google Scholar]
  33. Nuraeni, C.
    (2019) Using total physical response (TPR) method on young learners English language teaching. Metathesis: Journal of English Language, Literature, and Teaching, 3(1), 26–34. 10.31002/metathesis.v3i1.1223
     https://doi.org/10.31002/metathesis.v3i1.1223 [Google Scholar]
  34. Olmanson, J., & Liu, X. C.
    (2017) The challenge of Chinese character acquisition: Leveraging multimodality in overcoming a centuries-old problem. Emerging Learning Design Journal, 4(1), 1–9. digitalcommons.unl.edu/teachlearnfacpub/239
     [Google Scholar]
  35. Olmanson, J., Liu, X., Heselton, C. C., & Srivastava, A.
    (2019) DaZiBao: Multimodality in learning and communicating via Chinese characters. InK. -Y. Sung (Ed.), Teaching and Learning Chinese as a Second or Foreign Language: Emerging Trends (pp. 189–203). Rowman & Littlefield. 10.5040/9781978730472.ch‑013
     https://doi.org/10.5040/9781978730472.ch-013 [Google Scholar]
  36. Opitz, B., Schneiders, J. A., Krick, C. M., & Mecklinger, A.
    (2014) Selective transfer of visual working memory training on Chinese character learning. Neuropsychologia, 531, 1–11. 10.1016/j.neuropsychologia.2013.10.017
     https://doi.org/10.1016/j.neuropsychologia.2013.10.017 [Google Scholar]
  37. Paivio, A.
    (1991) Dual coding theory: Retrospect and current status. Canadian Journal of Psychology/Revue Canadienne de Psychologie, 45(3), 255–287. 10.1037/h0084295
     https://doi.org/10.1037/h0084295 [Google Scholar]
  38. Papi, M.
    (2010) The L2 motivational self system, L2 anxiety, and motivated behavior: A structural equation modeling approach. System, 38(3), 467–479. 10.1016/j.system.2010.06.011
     https://doi.org/10.1016/j.system.2010.06.011 [Google Scholar]
  39. Peng, J. E., & MacIntyre, P. D.
    (2025) Directional or reciprocal? A random intercept cross-lagged panel analysis of the relationships between emotions, motivation, willingness to communicate, and L2 achievement. Learning and Individual Differences, 1181, 102638. 10.1016/j.lindif.2025.102638
     https://doi.org/10.1016/j.lindif.2025.102638 [Google Scholar]
  40. Perfetti, C. A., Liu, Y., & Tan, L. H.
    (2005) The lexical constituency model: Some implications of research on Chinese for general theories of reading. Psychological Review, 112(1), 43–59. 10.1037/0033‑295X.112.1.43
     https://doi.org/10.1037/0033-295X.112.1.43 [Google Scholar]
  41. Quak, M., London, R. E., & Talsma, D.
    (2015) A multisensory perspective of working memory. Frontiers in Human Neuroscience, 91, 197. 10.3389/fnhum.2015.00197
     https://doi.org/10.3389/fnhum.2015.00197 [Google Scholar]
  42. Ramezanali, N., & Faez, F.
    (2019) Vocabulary learning and retention through multimedia glossing. Language Learning and Technology, 23(2), 105–124. 10.64152/10125/44685
     https://doi.org/10.64152/10125/44685 [Google Scholar]
  43. Repetto, C., Pedroli, E., & Macedonia, M.
    (2017) Enrichment effects of gestures and pictures on abstract words in a second language. Frontiers in Psychology, 81, 2136. 10.3389/fpsyg.2017.02136
     https://doi.org/10.3389/fpsyg.2017.02136 [Google Scholar]
  44. Ryan, R. M.
    (1982) Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. Journal of Personality and Social Psychology, 43(3), 450–461. 10.1037/0022‑3514.43.3.450
     https://doi.org/10.1037/0022-3514.43.3.450 [Google Scholar]
  45. Sadoski, M.
    (2018) Reading comprehension is embodied: Theoretical and practical considerations. Educational Psychological Review, 301, 331–349. 10.1007/s10648‑017‑9412‑8
     https://doi.org/10.1007/s10648-017-9412-8 [Google Scholar]
  46. Saito, K., Dewaele, J. M., Abe, M., & In’nami, Y.
    (2018) Motivation, emotion, learning experience, and second language comprehensibility development in classroom settings: A cross-sectional and longitudinal study. Language Learning, 68(3), 709–743. 10.1111/lang.12297
     https://doi.org/10.1111/lang.12297 [Google Scholar]
  47. Shu, H., Peng, H., & McBride-Chang, C.
    (2008) Phonological awareness in young Chinese children. Developmental Science, 11(1), 171–181. 10.1111/j.1467‑7687.2007.00654.x
     https://doi.org/10.1111/j.1467-7687.2007.00654.x [Google Scholar]
  48. Sorden, S. D.
    (2012) The cognitive theory of multimedia learning. InB. J. Irby, G. Brown, R. Lara-Alecio, & S. Jackson (Eds.), Handbook of educational theories (pp. 155–165). Information Age Publishing, Inc.
     [Google Scholar]
  49. Sun, H., Wang, T., & Yu, M.
    (2024) Influence of stroke-order learning on Chinese character recognition among Chinese as a second language learners. System, 1221, 10.1016/j.system.2024.103295
     https://doi.org/10.1016/j.system.2024.103295 [Google Scholar]
  50. Teng, M. F.
    (2023) The effectiveness of multimedia input on vocabulary learning and retention. Innovation in Language Learning and Teaching, 17(3), 738–754. 10.1080/17501229.2022.2131791
     https://doi.org/10.1080/17501229.2022.2131791 [Google Scholar]
  51. Teng, M., & Xu, J.
    (2025) Pushing vocabulary knowledge from receptive to productive mastery: Effects of task type and repetition frequency. Language Teaching Research, 29(2), 588–606. 10.1177/13621688221077028
     https://doi.org/10.1177/13621688221077028 [Google Scholar]
  52. Tseng, C. C., Hu, J. F., Chang, L. Y., & Chen, H. C.
    (2023) Learning to read Chinese: The roles of phonological awareness, paired–associate learning, and phonetic radical awareness. Reading and Writing, 36(7), 1769–1795. 10.1007/s11145‑022‑10352‑9
     https://doi.org/10.1007/s11145-022-10352-9 [Google Scholar]
  53. Verhagen, J., & Leseman, P.
    (2016) How do verbal short-term memory and working memory relate to the acquisition of vocabulary and grammar? A comparison between first and second language learners. Journal of Experimental Child Psychology, 1411, 65–82. 10.1016/j.jecp.2015.06.015
     https://doi.org/10.1016/j.jecp.2015.06.015 [Google Scholar]
  54. von Kriegstein, K.
    (2012) A multisensory perspective on human auditory communication. InM. M. Murray & M. T. Wallace (Eds.), The neural bases of multisensory processes (pp. 683–700). Boca Raton: Taylor & Francis
     [Google Scholar]
  55. Wu, C.-J., Chen, G.-D., & Huang, C.-W.
    (2014) Using digital board games for genuine communication in EFL classrooms. Educational Technology Research and Development, 62(2), 209–226. 10.1007/s11423‑013‑9329‑y
     https://doi.org/10.1007/s11423-013-9329-y [Google Scholar]
  56. Xiao, W., & Treiman, R.
    (2012) Iconicity of simple Chinese characters. Behavior Research Methods, 441, 954–960. 10.3758/s13428‑012‑0191‑3
     https://doi.org/10.3758/s13428-012-0191-3 [Google Scholar]
  57. Xu, S.
    (100 AD). Shuowen jiezi [Explaining simple and analyzing compound characters]. https://ctext.org/shuo-wen-jie-zi
  58. Xu, X., & Ke, F.
    (2020) Embodied interaction: Learning Chinese characters through body movements. Language Learning & Technology, 24(3), 136–159. hdl.handle.net/10125/44744. 10.64152/10125/44744
     https://doi.org/10.64152/10125/44744 [Google Scholar]
  59. Xu, Y., Chang, L. Y., Zhang, J., & Perfetti, C. A.
    (2013) Reading, writing, and animation in character learning in Chinese as a foreign language. Foreign Language Annals, 46(3), 423–444. 10.1111/flan.12040
     https://doi.org/10.1111/flan.12040 [Google Scholar]
  60. Yang, Y., Leung, H., Shum, H. P., Li, J., Zeng, L., Aslam, N., & Pan, Z.
    (2017) CCESK: A Chinese character educational system based on Kinect. IEEE Transactions on Learning Technologies, 11(3), 342–347. 10.1109/TLT.2017.2723888
     https://doi.org/10.1109/TLT.2017.2723888 [Google Scholar]
  61. Yashima, T., Nishida, R., & Mizumoto, A.
    (2017) Influence of learner beliefs and gender on the motivating power of L2 selves. The Modern Language Journal, 101(4), 691–711. 10.1111/modl.12430
     https://doi.org/10.1111/modl.12430 [Google Scholar]
  62. Zou, L., Desroches, A. S., Liu, Y., Xia, Z., & Shu, H.
    (2012) Orthographic facilitation in Chinese spoken word recognition: An ERP study. Brain and Language, 123(3), 164–173. 10.1016/j.bandl.2012.09.006
     https://doi.org/10.1016/j.bandl.2012.09.006 [Google Scholar]
/content/journals/10.1075/ijchl.00039.hua
Loading
Word learning and motivation through multimodal input for novice Chinese language learners
International Journal of Chinese Linguistics 12, 256 (2025); https://doi.org/10.1075/ijchl.00039.hua
/content/journals/10.1075/ijchl.00039.hua
/content/journals/10.1075/ijchl.00039.hua
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Chinese word learning; motivation; multimodal instruction

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error