1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 21, Issue 2
  5. Article
Volume 21, Issue 2-3
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Previous studies using cross-modal semantic priming have found that iconic gestures prime target words that are related with the gestures. In the present study, two analogous experiments examined this priming effect presenting prime and targets in high synchrony. In Experiment 1, participants performed an auditory primed lexical decision task where target words (e.g., “push”) and pseudowords had to be discriminated, primed by overlapping iconic gestures that could be semantically related (e.g., moving both hands forward) or not with the words. Experiment 2 was similar but with both gestures and words presented visually. The grammatical category of the words was also manipulated: they were nouns and verbs. It was found that words related to gestures were recognized faster and with fewer errors than the unrelated ones in both experiments and similarly for both types of words.

© 2023 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.20019.san
2023-08-24
2025-02-19

  • From This Site

    /content/journals/10.1075/gest.20019.san
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Aguasvivas, J. A., Carreiras, M., Brysbaert, M., Mandera, P., Keuleers, E., & Duñabeitia, J. A.
    (2018) SPALEX: A Spanish lexical decision database from a massive online data collection. Frontiers in Psychology, 91, 2156. 10.3389/fpsyg.2018.02156
     https://doi.org/10.3389/fpsyg.2018.02156 [Google Scholar]
  2. Alibali, M. W.
    (2005) Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition and Computation, 51, 307–331. 10.1207/s15427633scc0504_2
     https://doi.org/10.1207/s15427633scc0504_2 [Google Scholar]
  3. Alibali, M. W., Heath, D. C., & Myers, H. J.
    (2001) Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44 (2), 169–188. 10.1006/jmla.2000.2752
     https://doi.org/10.1006/jmla.2000.2752 [Google Scholar]
  4. Anderson, J. E., & Holcomb, P. J.
    (1995) Auditory and visual semantic priming using different stimulus onset asynchronies: An event-related brain potential study. Psychophysiology, 32 (2), 177–190. 10.1111/j.1469‑8986.1995.tb03310.x
     https://doi.org/10.1111/j.1469-8986.1995.tb03310.x [Google Scholar]
  5. Baayen, R. H., Davidson, D. J., & Bates, D. M.
    (2008) Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 591, 390–412. 10.1016/j.jml.2007.12.005
     https://doi.org/10.1016/j.jml.2007.12.005 [Google Scholar]
  6. Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J.
    (2013) Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68 (3), 255–278. 10.1016/j.jml.2012.11.001
     https://doi.org/10.1016/j.jml.2012.11.001 [Google Scholar]
  7. Barsalou, L. W., Santos, A., Simmons, W. K., & Wilson, C. D.
    (2008) Language and simulation in conceptual processing. InM. de Vega, A. Glenberg, & A. Graesser. (Eds.), Symbols and embodiment: Debates on meaning and cognition (pp.245–283). Oxford: Oxford University Press. 10.1093/acprof:oso/9780199217274.003.0013
     https://doi.org/10.1093/acprof:oso/9780199217274.003.0013 [Google Scholar]
  8. Bates, D. M.
    (2005) Fitting linear mixed models in R. R News, 51, 27–30.
     [Google Scholar]
  9. Bates, D. & Maechler, B.
    (2009) Lme 4: Linear mixed-effects models using S4 classes. R package version 0.999375-27.
     [Google Scholar]
  10. Beattie, G. & Shovelton, H.
    (2002) An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology, 931, 179–192. 10.1348/000712602162526
     https://doi.org/10.1348/000712602162526 [Google Scholar]
  11. Bernardis, P., Salillas, E., & Caramelli, N.
    (2008) Behavioural and neuropsychological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 251, 1114–1128. 10.1080/02643290801921707
     https://doi.org/10.1080/02643290801921707 [Google Scholar]
  12. De Marco, D., De Stefani, E., & Gentilucci, M.
    (2015) Gesture and word analysis: the same or different processes?Neuroimage, 1171, 375–385. 10.1016/j.neuroimage.2015.05.080
     https://doi.org/10.1016/j.neuroimage.2015.05.080 [Google Scholar]
  13. Driskell, J. E. & Radtke, P. H.
    (2003) The effect of gesture on speech production and comprehension. Human Factors, 45 (3), 445–454. 10.1518/hfes.45.3.445.27258
     https://doi.org/10.1518/hfes.45.3.445.27258 [Google Scholar]
  14. Forster, K. I.
    (1981) Priming and the effects of sentence and lexical contexts on naming time: Evidence for autonomous lexical processing. The Quarterly Journal of Experimental Psychology, 33 (4), 465–495. 10.1080/14640748108400804
     https://doi.org/10.1080/14640748108400804 [Google Scholar]
  15. Gentner, D.
    (1982) Why nouns are learned before verbs: Linguistic relativity versus natural partitioning. Center for the Study of Reading Technical Report, No. 257.
     [Google Scholar]
  16. Goh, W. D., Suárez, L., Yap, M. J., & Tan, S. H.
    (2009) Distributional analyses in auditory lexical decision: Neighborhood density and word-frequency effects. Psychonomic Bulletin & Review, 16 (5), 882–887. 10.3758/PBR.16.5.882
     https://doi.org/10.3758/PBR.16.5.882 [Google Scholar]
  17. Goldin-Meadow, S. & Wagner, S. M.
    (2005) How our hands help us learn. Trends in Cognitive Sciences, 9 (5), 234–241. 10.1016/j.tics.2005.03.006
     https://doi.org/10.1016/j.tics.2005.03.006 [Google Scholar]
  18. Goodwin, M. H. & Goodwin, C.
    (1986) Gesture and coparticipation in the activity of searching for a word. Semiotica, 621, 51–76. 10.1515/semi.1986.62.1‑2.51
     https://doi.org/10.1515/semi.1986.62.1-2.51 [Google Scholar]
  19. Habets, B., Kita, S., Shao, Z., Özyürek, A., & Hagoort, P.
    (2011) The role of synchrony and ambiguity in speech–gesture integration during comprehension. Journal of Cognitive Neuroscience, 23 (8), 1845–1854. 10.1162/jocn.2010.21462
     https://doi.org/10.1162/jocn.2010.21462 [Google Scholar]
  20. Hernández-Cabrera, J. A.
    (2011) ULLRToolbox. sites.google.com/site/toolbox
     [Google Scholar]
  21. Holcomb, P. J. & Anderson, J. E.
    (1993) Cross-modal semantic priming: A time-course analysis using event-related brain potentials. Language and Cognitive Processes, 8 (4), 379–411. 10.1080/01690969308407583
     https://doi.org/10.1080/01690969308407583 [Google Scholar]
  22. Holcomb, P. J. & Neville, H. J.
    (1990) Auditory and visual semantic priming in lexical decision: A comparison using event-related brain potentials. Language and Cognitive Processes, 5 (4), 281–312. 10.1080/01690969008407065
     https://doi.org/10.1080/01690969008407065 [Google Scholar]
  23. Hostetter, A. B.
    (2011) When do gestures communicate? A meta-analysis. Psychological Bulletin, 137 (2), 297–315. 10.1037/a0022128
     https://doi.org/10.1037/a0022128 [Google Scholar]
  24. Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M.
    (2009) Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human brain mapping, 30 (3), 1028–1037. 10.1002/hbm.20565
     https://doi.org/10.1002/hbm.20565 [Google Scholar]
  25. Jonides, J. & Mack, R.
    (1984) On the cost and benefit of cost and benefit. Psychological Bulletin, 961, 29–44. 10.1037/0033‑2909.96.1.29
     https://doi.org/10.1037/0033-2909.96.1.29 [Google Scholar]
  26. Kelly, S. D., Creigh, P., & Bartolotti, J.
    (2010) Integrating speech and iconic gestures in a Stroop-like task: evidence for automatic processing. Journal of Cognitive Neuroscience, 22 (4), 683–694. 10.1162/jocn.2009.21254
     https://doi.org/10.1162/jocn.2009.21254 [Google Scholar]
  27. Kelly, S. D., Manning, S. M., & Rodak, S.
    (2008) Gesture gives a hand to language and learning: Perspectives from cognitive neuroscience, developmental psychology and education. Language and Linguistics Compass, 2 (4), 569–588. 10.1111/j.1749‑818X.2008.00067.x
     https://doi.org/10.1111/j.1749-818X.2008.00067.x [Google Scholar]
  28. Kelly, S. D., Özyürek, A., & Maris, E.
    (2010) Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21 (2), 260–267. 10.1177/0956797609357327
     https://doi.org/10.1177/0956797609357327 [Google Scholar]
  29. Kelly, S., Healey, M., Özyürek, A., & Holler, J.
    (2015) The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin & Review, 22 (2), 517–523. 10.3758/s13423‑014‑0681‑7
     https://doi.org/10.3758/s13423-014-0681-7 [Google Scholar]
  30. Kendon, A.
    (1980) Gesticulation and speech: Two aspects of the process of utterance. InM. R. Key. (Ed.), The relationship of verbal and nonverbal communication (pp.207–227). The Hague, the Netherlands: Mouton. 10.1515/9783110813098.207
     https://doi.org/10.1515/9783110813098.207 [Google Scholar]
  31. (1994) Do gestures communicate? A review. Research on Language and Social Interaction, 27 (3), 175–200. 10.1207/s15327973rlsi2703_2
     https://doi.org/10.1207/s15327973rlsi2703_2 [Google Scholar]
  32. Kita, S. & Öyürek, A.
    (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 481, 16–32. 10.1016/S0749‑596X(02)00505‑3
     https://doi.org/10.1016/S0749-596X(02)00505-3 [Google Scholar]
  33. Krahmer, E. & Swerts, M.
    (2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57 (3), 396–414. 10.1016/j.jml.2007.06.005
     https://doi.org/10.1016/j.jml.2007.06.005 [Google Scholar]
  34. Krauss, R. M.
    (1998) Why do we gesture when we speak?Current Directions in Psychological Science, 71, 54–59. 10.1111/1467‑8721.ep13175642
     https://doi.org/10.1111/1467-8721.ep13175642 [Google Scholar]
  35. Krauss, R. M., Dushay, R. A., Chen, Y., & Rauscher, F.
    (1995) The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 311, 533–552. 10.1006/jesp.1995.1024
     https://doi.org/10.1006/jesp.1995.1024 [Google Scholar]
  36. Krauss, R. M., Morrel-Samuels, P., & Colasante, C.
    (1991) Do conversational hand gestures communicate?Journal of Personality and Social Psychology, 611, 743–754. 10.1037/0022‑3514.61.5.743
     https://doi.org/10.1037/0022-3514.61.5.743 [Google Scholar]
  37. Krauss, R. M., Chen, Y., & Gottesman, R. F.
    (2000) Lexical gestures and lexical access: a process model. InD. McNeill. (Ed.), Language and gesture (pp.261–283). New York: Cambridge University Press. 10.1017/CBO9780511620850.017
     https://doi.org/10.1017/CBO9780511620850.017 [Google Scholar]
  38. Martuzzi, R., van der Zwaag, W., Farthouat, J., Gruetter, R., & Blanke, O.
    (2014) Human finger somatotopy in areas 3b, 1, and 2: a 7T fMRI study using a natural stimulus. Human Brain Mapping, 35 (1), 213–226. 10.1002/hbm.22172
     https://doi.org/10.1002/hbm.22172 [Google Scholar]
  39. McNeill, D.
    (1985) So you think gestures are nonverbal?Psychological Review, 92 (3), 350–371. 10.1037/0033‑295X.92.3.350
     https://doi.org/10.1037/0033-295X.92.3.350 [Google Scholar]
  40. (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
     [Google Scholar]
  41. (2005) Gesture and thought. Chicago: University of Chicago Press. 10.7208/chicago/9780226514642.001.0001
     https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
  42. Morrel-Samuels, P. & Krauss, R. M.
    (1992) Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, and Cognition, 181, 615–623.
     [Google Scholar]
  43. Ng, M. M., Goh, W. D., Yap, M. J., Tse, C. S., & So, W. C.
    (2017) How we think about temporal words: A gestural priming study in English and Chinese. Frontiers in Psychology, 81, 974. 10.3389/fpsyg.2017.00974
     https://doi.org/10.3389/fpsyg.2017.00974 [Google Scholar]
  44. Perea, M. & Rosa, E.
    (2002) The effects of associative and semantic priming in the lexical decision task. Psychological Research, 66 (3), 180–194. 10.1007/s00426‑002‑0086‑5
     https://doi.org/10.1007/s00426-002-0086-5 [Google Scholar]
  45. Schneider, W., Eschmann, A., & Zuccolotto, A.
    (2002) E-Prime user’s guide. Pittsburgh, PA: Psychology Software Tools, Inc.
     [Google Scholar]
  46. Sidhu, D. M., Vigliocco, G., & Pexman, P. M.
    (2020) Effects of iconicity in lexical decision. Language and Cognition, 12 (1), 164–181. 10.1017/langcog.2019.36
     https://doi.org/10.1017/langcog.2019.36 [Google Scholar]
  47. Slobin, D. I.
    (1987) Thinking for speaking. InAnnual Meeting of the Berkeley Linguistics Society, 131, 435–445. 10.3765/bls.v13i0.1826
     https://doi.org/10.3765/bls.v13i0.1826 [Google Scholar]
  48. (1996) From ‘‘thought and language’’ to ‘‘thinking for speaking’’. InJ. J. Gumperz & S. C. Levinson. (Eds.), Rethinking linguistic relativity (pp.70–96). Cambridge: Cambridge University Press.
     [Google Scholar]
  49. So, W. C., Low, A., Yap, D. F., Kheng, E., & Yap, M.
    (2013) Iconic gestures prime words: comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 41, 779. 10.3389/fpsyg.2013.00779
     https://doi.org/10.3389/fpsyg.2013.00779 [Google Scholar]
  50. Vitevitch, M. S. & Luce, P. A.
    (1998) When words compete: Levels of processing in perception of spoken words. Psychological Science, 9 (4), 325–329. 10.1111/1467‑9280.00064
     https://doi.org/10.1111/1467-9280.00064 [Google Scholar]
  51. Wilson, M. & Emmorey, K.
    (2006) No difference in short-term memory span between sign and speech. Psychological Science – Cambridge, 17 (12), 1093–1094. 10.1111/j.1467‑9280.2006.01835.x
     https://doi.org/10.1111/j.1467-9280.2006.01835.x [Google Scholar]
  52. Wilson, M. & Knoblich, G.
    (2005) The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131 (3), 460–473. 10.1037/0033‑2909.131.3.460
     https://doi.org/10.1037/0033-2909.131.3.460 [Google Scholar]
  53. Wu, Y. C. & Coulson, S.
    (2005) Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology, 421, 654–667. 10.1111/j.1469‑8986.2005.00356.x
     https://doi.org/10.1111/j.1469-8986.2005.00356.x [Google Scholar]
  54. (2007a) Iconic gestures prime related concepts: An ERP study. Psychonomic Bulletin and Review, 14 (1), 57–63. 10.3758/BF03194028
     https://doi.org/10.3758/BF03194028 [Google Scholar]
  55. (2007b) How iconic gestures enhance communication: An ERP study. Brain and Language, 1011, 234–245. 10.1016/j.bandl.2006.12.003
     https://doi.org/10.1016/j.bandl.2006.12.003 [Google Scholar]
  56. Yap, D. F., So, W. C., Melvin Yap, J. M., Tan, Y. Q., & Teoh, R. L. S.
    (2011) Iconic gestures prime words. Cognitive Science, 35 (1), 171–183. 10.1111/j.1551‑6709.2010.01141.x
     https://doi.org/10.1111/j.1551-6709.2010.01141.x [Google Scholar]
/content/journals/10.1075/gest.20019.san
Loading
Iconic gestures serve as primes for both auditory and visual word forms
Gesture 21, 296 (2022); https://doi.org/10.1075/gest.20019.san
/content/journals/10.1075/gest.20019.san
/content/journals/10.1075/gest.20019.san
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): cross-modal priming; iconic gesture; semantic priming; word processing

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error