1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 21, Issue 2
  5. Article
Volume 21, Issue 2-3
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Co-speech gestures can help the learning, processing, and memory of words and concepts, particularly motoric and spatial concepts such as verbs. The purpose of the present studies was to test whether co-speech gestures support the learning of words through gist traces of movement. We asked English monolinguals to learn 40 Cantonese words (20 verbs and 20 nouns). In two studies, we found support for the gist traces of congruent gestures being movement: participants who saw congruent gestures while hearing Cantonese words thought they had seen more verbs than participants in any other condition. However, gist traces were unrelated to the accurate recall of either nouns or verbs. In both studies, learning Cantonese words accompanied by congruent gestures tended to interfere with the learning of nouns (but not verbs). In Study 2, we ruled out the possibility that this interference was due either to gestures conveying representational information in another medium or to distraction from moving hands. We argue that gestures can interfere with learning foreign language words when they represent the referents (e.g., show shape or size) because learners must interpret the hands as something other than hands.

© 2023 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.18020.nic
2023-08-21
2025-04-27

  • From This Site

    /content/journals/10.1075/gest.18020.nic
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Alibali, Martha
    (2005) Gesture in spatial cognition: expressing, communicating, and thinking about spatial information. Spatial Cognition and Computation, 51, 307–331. 10.1207/s15427633scc0504_2
     https://doi.org/10.1207/s15427633scc0504_2 [Google Scholar]
  2. Alibali, Martha W., Flevares, Lucia M., & Goldin-Meadow, Susan
    (1997) Assessing knowledge conveyed in gesture: Do teachers have the upper hand?Journal of Educational Psychology, 891, 183–193. 10.1037/0022‑0663.89.1.183
     https://doi.org/10.1037/0022-0663.89.1.183 [Google Scholar]
  3. Andren, Mats & Blomberg, Johan
    (2018) Children’s use of gesture and action with static and dynamic verbs. Language, Interaction, and Acquisition, 91, 22–39. 10.1075/lia.15015.and
     https://doi.org/10.1075/lia.15015.and [Google Scholar]
  4. Beattie, Geoffrey & Shovelton, Heather
    (1999) Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology, 181, 438–462. 10.1177/0261927X99018004005
     https://doi.org/10.1177/0261927X99018004005 [Google Scholar]
  5. Brainerd, Charles J. & Reyna, Valerie F.
    (2004) Fuzzy-trace theory and memory development. Developmental Review, 241, 396–439. 10.1016/j.dr.2004.08.005
     https://doi.org/10.1016/j.dr.2004.08.005 [Google Scholar]
  6. Broaders, Sara C., Cook, Susan Wagner, Mitchell, Zachary, & Goldin-Meadow, Susan
    (2007) Making children gesture brings out implicit knowledge and leads to learning. Journal of Experimental Psychology: General, 1361, 539–550. 10.1037/0096‑3445.136.4.539
     https://doi.org/10.1037/0096-3445.136.4.539 [Google Scholar]
  7. Bub, Daniel N. & Masson, Michael E. J.
    (2006) Gestural knowledge evoked by objects as part of conceptual representations. Aphasiology, 201, 1112–1124. 10.1080/02687030600741667
     https://doi.org/10.1080/02687030600741667 [Google Scholar]
  8. Cave, Carolyn Backer, Bost, Preston R., & Cobb, Ronald E.
    (1996) Effects of color and pattern on implicit and explicit picture memory. Journal of Experimental Psychology: Learning, Memory, and Cognition, 221, 639–653.
     [Google Scholar]
  9. Choi, Soojung & Lantolf, James P.
    (2008) Representation and embodiment of meaning in L2 communication: Motion events in speech and gesture of advanced L2 Korean and L2 English speakers. Studies in Second Language Acquisition, 301, 191–224. 10.1017/S0272263108080315
     https://doi.org/10.1017/S0272263108080315 [Google Scholar]
  10. Church, R. Breckinridge & Goldin-Meadow, Susan
    (1986) The mismatch between gesture and speech as an index of transitional knowledge. Cognition, 231, 43–71. 10.1016/0010‑0277(86)90053‑3
     https://doi.org/10.1016/0010-0277(86)90053-3 [Google Scholar]
  11. de Nooijer, Jacqueline A., van Gog, Tamara, Paas, Fred, & Zwaan, Rolf A.
    (2014) Words in action: Using gestures to improve verb learning in primary school children. Gesture, 141, 46–69. 10.1075/gest.14.1.03noo
     https://doi.org/10.1075/gest.14.1.03noo [Google Scholar]
  12. Goldin-Meadow, Susan, Kim, San, & Singer, Melissa
    (1999) What the teachers’ hands tell the students’ minds about math. Journal of Educational Psychology, 911, 720–730. 10.1037/0022‑0663.91.4.720
     https://doi.org/10.1037/0022-0663.91.4.720 [Google Scholar]
  13. Goldin-Meadow, Susan & Sandhofer, Catherine Momeni
    (1999) Gesture conveys substantive information about a child’s thoughts to ordinary listeners. Developmental Science, 21, 67–74. 10.1111/1467‑7687.00056
     https://doi.org/10.1111/1467-7687.00056 [Google Scholar]
  14. Goldin-Meadow, Susan, So, Wing Chee, Özyürek, Aslı, & Mylander, Carolyn
    (2008) The natural order of events: How speakers of different languages represent events nonverbally. Proceedings of the National Academy of Sciences, 1051, 9163–9168. 10.1073/pnas.0710060105
     https://doi.org/10.1073/pnas.0710060105 [Google Scholar]
  15. Goodrich, Whitney & Kam, Carla L.
    (2009) Co-speech gesture as input in verb learning. Developmental Science, 121, 81–87. 10.1111/j.1467‑7687.2008.00735.x
     https://doi.org/10.1111/j.1467-7687.2008.00735.x [Google Scholar]
  16. Hadar, Uri & Krauss, Robert K.
    (1999) Iconic gestures: The grammatical categories of lexical affiliates. Journal of Neurolinguistics, 121, 1–12. 10.1016/S0911‑6044(99)00001‑9
     https://doi.org/10.1016/S0911-6044(99)00001-9 [Google Scholar]
  17. Hostetter, Autumn B. & Alibali, Martha W.
    (2019) Gesture as simulated action: Revisiting the framework. Psychonomic Bulletin & Review, 261, 721–752. 10.3758/s13423‑018‑1548‑0
     https://doi.org/10.3758/s13423-018-1548-0 [Google Scholar]
  18. (2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin and Review, 151, 495–514. 10.3758/PBR.15.3.495
     https://doi.org/10.3758/PBR.15.3.495 [Google Scholar]
  19. Howe, Mark L., Garner, Sarah R., Dewhurst, Stephen A., & Ball, Linden J.
    (2010) Can false memories prime problem solutions?Cognition, 1171, 176–181. 10.1016/j.cognition.2010.08.009
     https://doi.org/10.1016/j.cognition.2010.08.009 [Google Scholar]
  20. Kelly, Spencer D. & Church, R. Breckinridge
    (1998) A comparison between children’s and adults’ ability to detect conceptual information conveyed through representational gestures. Child Development, 691, 85–93. 10.1111/j.1467‑8624.1998.tb06135.x
     https://doi.org/10.1111/j.1467-8624.1998.tb06135.x [Google Scholar]
  21. Kelly, Spencer D., Kravitz, Corinne, & Hopkins, Michael
    (2004) Neural correlates of bimodal speech and gesture comprehension. Brain and Language, 891, 253–260. 10.1016/S0093‑934X(03)00335‑3
     https://doi.org/10.1016/S0093-934X(03)00335-3 [Google Scholar]
  22. Kelly, Spencer D., McDevitt, Tara, & Esch, Megan
    (2009) Brief training with co-speech gesture lends a hand to word learning in a foreign language. Language and Cognitive Processing, 241, 313–334. 10.1080/01690960802365567
     https://doi.org/10.1080/01690960802365567 [Google Scholar]
  23. Kendon, Adam
    (1980) Gesticulation and speech: Two aspects of the process of utterance. InM. R. Key (Ed.), The relationship of verbal and non-verbal communication (pp.207–228). The Hague, the Netherlands: Mouton. 10.1515/9783110813098.207
     https://doi.org/10.1515/9783110813098.207 [Google Scholar]
  24. Kita, Sotaro & Özyürek, Aslı
    (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 481, 16–32. 10.1016/S0749‑596X(02)00505‑3
     https://doi.org/10.1016/S0749-596X(02)00505-3 [Google Scholar]
  25. Lazaraton, Anne
    (2004) Gesture and speech in the vocabulary explanations of one ESL teacher: A microanalytic inquiry. Language Learning, 541, 79–117. 10.1111/j.1467‑9922.2004.00249.x
     https://doi.org/10.1111/j.1467-9922.2004.00249.x [Google Scholar]
  26. Macedonia, Manuela, Müller, Karsten, & Friederici, Angela D.
    (2010a) Neural correlates of high performance in foreign language vocabulary learning. Mind, Brain, and Education, 41, 125–134. 10.1111/j.1751‑228X.2010.01091.x
     https://doi.org/10.1111/j.1751-228X.2010.01091.x [Google Scholar]
  27. (2010b) The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Mapping, 321, 982–998. 10.1002/hbm.21084
     https://doi.org/10.1002/hbm.21084 [Google Scholar]
  28. Masson, Michael E. J., Bub, Daniel N., Newton-Taylor, Meaghan
    (2008) Language-based access to gestural components of conceptual knowledge. The Quarterly Journal of Experimental Psychology, 611, 869–882. 10.1080/17470210701623829
     https://doi.org/10.1080/17470210701623829 [Google Scholar]
  29. McBride, Dawn M., Coane, Jennifer H. & Raulerson III, Bascom A.
    (2006) An investigation of false memory in perceptual implicit tasks. Acta Psychologica, 1231, 240–260. 10.1016/j.actpsy.2006.01.002
     https://doi.org/10.1016/j.actpsy.2006.01.002 [Google Scholar]
  30. McNeil, Nicole M., Alibali, Martha W., & Evans, Julia L.
    (2000) The role of gesture in children’s comprehension of spoken language: Now they need it, now they don’t. Journal of Nonverbal Behavior, 241, 131–150. 10.1023/A:1006657929803
     https://doi.org/10.1023/A:1006657929803 [Google Scholar]
  31. McNeill, David
    (2003) Aspects of aspects. Gesture, 31, 1–17. 10.1075/gest.3.1.02mcn
     https://doi.org/10.1075/gest.3.1.02mcn [Google Scholar]
  32. (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
     [Google Scholar]
  33. McNeill, David, Cassell, Justine, & McCullough, Karl-Erik
    (1994) Communicative effects of speech-mismatched gestures. Research on Language and Social Interaction, 271, 223–237. 10.1207/s15327973rlsi2703_4
     https://doi.org/10.1207/s15327973rlsi2703_4 [Google Scholar]
  34. Müller, Cornelia
    (2013) Gestural modes of representation as techniques of depiction. InC. Müller, A. J. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & S. Teßendorf (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (pp.1687–1701). Berlin: De Gruyter Mouton.
     [Google Scholar]
  35. Mumford, Katherine H. & Kita, Sotaro
    (2014) Children use gesture to interpret novel verb meanings. Child Development, 851, 1181–1189. 10.1111/cdev.12188
     https://doi.org/10.1111/cdev.12188 [Google Scholar]
  36. Nyst, Victoria
    (2016) The depiction of size and shape in gestures accompanying object descriptions in Anyi (Côte d’Ivoire) and in Dutch (The Netherlands). Gesture, 151, 156–191. 10.1075/gest.15.2.02nys
     https://doi.org/10.1075/gest.15.2.02nys [Google Scholar]
  37. Odegard, Timothy N. & Lampinen, James M.
    (2005) Recollection rejection: Gist cuing of verbatim memory. Memory and Cognition, 331, 1422–1430. 10.3758/BF03193375
     https://doi.org/10.3758/BF03193375 [Google Scholar]
  38. Ortega, Gerardo & Özyürek, Aslı
    (2020) Systematic mappings between semantic categories and types of iconic representations in the manual modality: A normed database of silent gesture. Behavior Research Methods, 521, 51–67. 10.3758/s13428‑019‑01204‑6
     https://doi.org/10.3758/s13428-019-01204-6 [Google Scholar]
  39. Özçaliskan, Şeyda, Gentner, Dedre, & Goldin-Meadow, Susan
    (2014) Do iconic gestures pave the way for children’s early verbs?Applied Psycholinguistics, 351, 1143–1162. 10.1017/S0142716412000720
     https://doi.org/10.1017/S0142716412000720 [Google Scholar]
  40. Özyürek, Aslı, Willems, Roel M., Kita, Sotaro, & Hagoort, Peter
    (2007) On-line integration of semantic information from speech and gesture: Insights from event-related brain potentials. Journal of Cognitive Neuroscience, 191, 605–616. 10.1162/jocn.2007.19.4.605
     https://doi.org/10.1162/jocn.2007.19.4.605 [Google Scholar]
  41. Padden, Carol, Hwang, So-One, Lepic, Ryan, & Seegers, Sharon
    (2015) Tools for language: Patterned iconicity in sign language nouns and verbs. Topics in Cognitive Science, 71, 81–94. 10.1111/tops.12121
     https://doi.org/10.1111/tops.12121 [Google Scholar]
  42. Piccin, Thomas B. & Waxman, Sandra R.
    (2007) Why nouns trump verbs in word learning: New evidence from children and adults in the human simulation paradigm. Language Learning and Development, 31, 295–323. 10.1080/15475440701377535
     https://doi.org/10.1080/15475440701377535 [Google Scholar]
  43. Reales, José Manuel & Ballesteros, Soledad
    (1999) Implicit and explicit memory for visual and haptic objects: Cross-modal priming depends on structural descriptions. Journal of Experimental Psychology: Learning, Memory, and Cognition, 251, 644–663.
     [Google Scholar]
  44. Rüschemeyer, Shirley-Ann, Brass, Marcel, & Friederici, Angela D.
    (2007) Comprehending prehending: Neural correlates of processing verbs with motor stems. Journal of Cognitive Neuroscience, 191, 855–865. 10.1162/jocn.2007.19.5.855
     https://doi.org/10.1162/jocn.2007.19.5.855 [Google Scholar]
  45. Schönpflug, Ute
    (2008) Pauses in elementary school children’s verbatim and gist free recall of a story. Cognitive Development, 231, 385–394. 10.1016/j.cogdev.2008.05.002
     https://doi.org/10.1016/j.cogdev.2008.05.002 [Google Scholar]
  46. Singer, Melissa A. & Goldin-Meadow, Susan
    (2005) Children learn when their teacher’s gestures and speech differ. Psychological Science, 161, 85–89. 10.1111/j.0956‑7976.2005.00786.x
     https://doi.org/10.1111/j.0956-7976.2005.00786.x [Google Scholar]
  47. Sowa, Timo & Wachsmuth, Ipke
    (2009) A computational model for the representation and processing of shape in coverbal iconic gestures. InKenny R. Coventry, Thora Tenbrink, & John Bateman (Eds.), Spatial language and dialogue (pp.132–146). Oxford: Oxford University Press. 10.1093/acprof:oso/9780199554201.003.0010
     https://doi.org/10.1093/acprof:oso/9780199554201.003.0010 [Google Scholar]
  48. Wang, Xiao-lei & Plotka, Raquel
    (2018) Lending a helping hand for English-Chinese bilingual children’s idiom comprehension and retention: Implications for early childhood educators. Early Years, 38 (3), 298–315. 10.1080/09575146.2016.1258693
     https://doi.org/10.1080/09575146.2016.1258693 [Google Scholar]
  49. Wesp, Richard, Hess, Jennifer, Keutmann, Donna, & Wheaton, Karen
    (2001) Gestures maintain spatial imagery. The American Journal of Psychology, 1141, 591–600. 10.2307/1423612
     https://doi.org/10.2307/1423612 [Google Scholar]
  50. Westbury, Chris & Hollis, Geoff
    (2019) Conceptualizing syntactic categories as semantic categories: Unifying part-of-speech identification and semantics using co-occurrence vector averaging. Behavior Research Methods, 51 (3), 1371–1398. 10.3758/s13428‑018‑1118‑4
     https://doi.org/10.3758/s13428-018-1118-4 [Google Scholar]
  51. Wu, Ying Choon & Coulson, Seana
    (2007) How iconic gestures enhance communication: An ERP study. Brain and Language, 1011, 234–245. 10.1016/j.bandl.2006.12.003
     https://doi.org/10.1016/j.bandl.2006.12.003 [Google Scholar]
/content/journals/10.1075/gest.18020.nic
Loading
Co-speech gestures can interfere with learning foreign language words*
Gesture 21, 239 (2022); https://doi.org/10.1075/gest.18020.nic
/content/journals/10.1075/gest.18020.nic
/content/journals/10.1075/gest.18020.nic
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): congruent gestures; gist traces; implicit memory; representation; word learning

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error