1887
Volume 21, Issue 2-3
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Previous studies using cross-modal semantic priming have found that iconic gestures prime target words that are related with the gestures. In the present study, two analogous experiments examined this priming effect presenting prime and targets in high synchrony. In Experiment 1, participants performed an auditory primed lexical decision task where target words (e.g., “push”) and pseudowords had to be discriminated, primed by overlapping iconic gestures that could be semantically related (e.g., moving both hands forward) or not with the words. Experiment 2 was similar but with both gestures and words presented visually. The grammatical category of the words was also manipulated: they were nouns and verbs. It was found that words related to gestures were recognized faster and with fewer errors than the unrelated ones in both experiments and similarly for both types of words.

Loading

Article metrics loading...

/content/journals/10.1075/gest.20019.san
2023-08-24
2024-05-19
Loading full text...

Full text loading...

References

  1. Aguasvivas, J. A., Carreiras, M., Brysbaert, M., Mandera, P., Keuleers, E., & Duñabeitia, J. A.
    (2018) SPALEX: A Spanish lexical decision database from a massive online data collection. Frontiers in Psychology, 91, 2156. 10.3389/fpsyg.2018.02156
    https://doi.org/10.3389/fpsyg.2018.02156 [Google Scholar]
  2. Alibali, M. W.
    (2005) Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition and Computation, 51, 307–331. 10.1207/s15427633scc0504_2
    https://doi.org/10.1207/s15427633scc0504_2 [Google Scholar]
  3. Alibali, M. W., Heath, D. C., & Myers, H. J.
    (2001) Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44 (2), 169–188. 10.1006/jmla.2000.2752
    https://doi.org/10.1006/jmla.2000.2752 [Google Scholar]
  4. Anderson, J. E., & Holcomb, P. J.
    (1995) Auditory and visual semantic priming using different stimulus onset asynchronies: An event-related brain potential study. Psychophysiology, 32 (2), 177–190. 10.1111/j.1469‑8986.1995.tb03310.x
    https://doi.org/10.1111/j.1469-8986.1995.tb03310.x [Google Scholar]
  5. Baayen, R. H., Davidson, D. J., & Bates, D. M.
    (2008) Mixed-effects modeling with crossed random effects for subjects and items. Journal of Memory and Language, 591, 390–412. 10.1016/j.jml.2007.12.005
    https://doi.org/10.1016/j.jml.2007.12.005 [Google Scholar]
  6. Barr, D. J., Levy, R., Scheepers, C., & Tily, H. J.
    (2013) Random effects structure for confirmatory hypothesis testing: Keep it maximal. Journal of Memory and Language, 68 (3), 255–278. 10.1016/j.jml.2012.11.001
    https://doi.org/10.1016/j.jml.2012.11.001 [Google Scholar]
  7. Barsalou, L. W., Santos, A., Simmons, W. K., & Wilson, C. D.
    (2008) Language and simulation in conceptual processing. InM. de Vega, A. Glenberg, & A. Graesser. (Eds.), Symbols and embodiment: Debates on meaning and cognition (pp.245–283). Oxford: Oxford University Press. 10.1093/acprof:oso/9780199217274.003.0013
    https://doi.org/10.1093/acprof:oso/9780199217274.003.0013 [Google Scholar]
  8. Bates, D. M.
    (2005) Fitting linear mixed models in R. R News, 51, 27–30.
    [Google Scholar]
  9. Bates, D. & Maechler, B.
    (2009) Lme 4: Linear mixed-effects models using S4 classes. R package version 0.999375-27.
    [Google Scholar]
  10. Beattie, G. & Shovelton, H.
    (2002) An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology, 931, 179–192. 10.1348/000712602162526
    https://doi.org/10.1348/000712602162526 [Google Scholar]
  11. Bernardis, P., Salillas, E., & Caramelli, N.
    (2008) Behavioural and neuropsychological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 251, 1114–1128. 10.1080/02643290801921707
    https://doi.org/10.1080/02643290801921707 [Google Scholar]
  12. De Marco, D., De Stefani, E., & Gentilucci, M.
    (2015) Gesture and word analysis: the same or different processes?Neuroimage, 1171, 375–385. 10.1016/j.neuroimage.2015.05.080
    https://doi.org/10.1016/j.neuroimage.2015.05.080 [Google Scholar]
  13. Driskell, J. E. & Radtke, P. H.
    (2003) The effect of gesture on speech production and comprehension. Human Factors, 45 (3), 445–454. 10.1518/hfes.45.3.445.27258
    https://doi.org/10.1518/hfes.45.3.445.27258 [Google Scholar]
  14. Forster, K. I.
    (1981) Priming and the effects of sentence and lexical contexts on naming time: Evidence for autonomous lexical processing. The Quarterly Journal of Experimental Psychology, 33 (4), 465–495. 10.1080/14640748108400804
    https://doi.org/10.1080/14640748108400804 [Google Scholar]
  15. Gentner, D.
    (1982) Why nouns are learned before verbs: Linguistic relativity versus natural partitioning. Center for the Study of Reading Technical Report, No. 257.
    [Google Scholar]
  16. Goh, W. D., Suárez, L., Yap, M. J., & Tan, S. H.
    (2009) Distributional analyses in auditory lexical decision: Neighborhood density and word-frequency effects. Psychonomic Bulletin & Review, 16 (5), 882–887. 10.3758/PBR.16.5.882
    https://doi.org/10.3758/PBR.16.5.882 [Google Scholar]
  17. Goldin-Meadow, S. & Wagner, S. M.
    (2005) How our hands help us learn. Trends in Cognitive Sciences, 9 (5), 234–241. 10.1016/j.tics.2005.03.006
    https://doi.org/10.1016/j.tics.2005.03.006 [Google Scholar]
  18. Goodwin, M. H. & Goodwin, C.
    (1986) Gesture and coparticipation in the activity of searching for a word. Semiotica, 621, 51–76. 10.1515/semi.1986.62.1‑2.51
    https://doi.org/10.1515/semi.1986.62.1-2.51 [Google Scholar]
  19. Habets, B., Kita, S., Shao, Z., Özyürek, A., & Hagoort, P.
    (2011) The role of synchrony and ambiguity in speech–gesture integration during comprehension. Journal of Cognitive Neuroscience, 23 (8), 1845–1854. 10.1162/jocn.2010.21462
    https://doi.org/10.1162/jocn.2010.21462 [Google Scholar]
  20. Hernández-Cabrera, J. A.
    (2011) ULLRToolbox. sites.google.com/site/toolbox
    [Google Scholar]
  21. Holcomb, P. J. & Anderson, J. E.
    (1993) Cross-modal semantic priming: A time-course analysis using event-related brain potentials. Language and Cognitive Processes, 8 (4), 379–411. 10.1080/01690969308407583
    https://doi.org/10.1080/01690969308407583 [Google Scholar]
  22. Holcomb, P. J. & Neville, H. J.
    (1990) Auditory and visual semantic priming in lexical decision: A comparison using event-related brain potentials. Language and Cognitive Processes, 5 (4), 281–312. 10.1080/01690969008407065
    https://doi.org/10.1080/01690969008407065 [Google Scholar]
  23. Hostetter, A. B.
    (2011) When do gestures communicate? A meta-analysis. Psychological Bulletin, 137 (2), 297–315. 10.1037/a0022128
    https://doi.org/10.1037/a0022128 [Google Scholar]
  24. Hubbard, A. L., Wilson, S. M., Callan, D. E., & Dapretto, M.
    (2009) Giving speech a hand: Gesture modulates activity in auditory cortex during speech perception. Human brain mapping, 30 (3), 1028–1037. 10.1002/hbm.20565
    https://doi.org/10.1002/hbm.20565 [Google Scholar]
  25. Jonides, J. & Mack, R.
    (1984) On the cost and benefit of cost and benefit. Psychological Bulletin, 961, 29–44. 10.1037/0033‑2909.96.1.29
    https://doi.org/10.1037/0033-2909.96.1.29 [Google Scholar]
  26. Kelly, S. D., Creigh, P., & Bartolotti, J.
    (2010) Integrating speech and iconic gestures in a Stroop-like task: evidence for automatic processing. Journal of Cognitive Neuroscience, 22 (4), 683–694. 10.1162/jocn.2009.21254
    https://doi.org/10.1162/jocn.2009.21254 [Google Scholar]
  27. Kelly, S. D., Manning, S. M., & Rodak, S.
    (2008) Gesture gives a hand to language and learning: Perspectives from cognitive neuroscience, developmental psychology and education. Language and Linguistics Compass, 2 (4), 569–588. 10.1111/j.1749‑818X.2008.00067.x
    https://doi.org/10.1111/j.1749-818X.2008.00067.x [Google Scholar]
  28. Kelly, S. D., Özyürek, A., & Maris, E.
    (2010) Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21 (2), 260–267. 10.1177/0956797609357327
    https://doi.org/10.1177/0956797609357327 [Google Scholar]
  29. Kelly, S., Healey, M., Özyürek, A., & Holler, J.
    (2015) The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin & Review, 22 (2), 517–523. 10.3758/s13423‑014‑0681‑7
    https://doi.org/10.3758/s13423-014-0681-7 [Google Scholar]
  30. Kendon, A.
    (1980) Gesticulation and speech: Two aspects of the process of utterance. InM. R. Key. (Ed.), The relationship of verbal and nonverbal communication (pp.207–227). The Hague, the Netherlands: Mouton. 10.1515/9783110813098.207
    https://doi.org/10.1515/9783110813098.207 [Google Scholar]
  31. (1994) Do gestures communicate? A review. Research on Language and Social Interaction, 27 (3), 175–200. 10.1207/s15327973rlsi2703_2
    https://doi.org/10.1207/s15327973rlsi2703_2 [Google Scholar]
  32. Kita, S. & Öyürek, A.
    (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 481, 16–32. 10.1016/S0749‑596X(02)00505‑3
    https://doi.org/10.1016/S0749-596X(02)00505-3 [Google Scholar]
  33. Krahmer, E. & Swerts, M.
    (2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57 (3), 396–414. 10.1016/j.jml.2007.06.005
    https://doi.org/10.1016/j.jml.2007.06.005 [Google Scholar]
  34. Krauss, R. M.
    (1998) Why do we gesture when we speak?Current Directions in Psychological Science, 71, 54–59. 10.1111/1467‑8721.ep13175642
    https://doi.org/10.1111/1467-8721.ep13175642 [Google Scholar]
  35. Krauss, R. M., Dushay, R. A., Chen, Y., & Rauscher, F.
    (1995) The communicative value of conversational hand gestures. Journal of Experimental Social Psychology, 311, 533–552. 10.1006/jesp.1995.1024
    https://doi.org/10.1006/jesp.1995.1024 [Google Scholar]
  36. Krauss, R. M., Morrel-Samuels, P., & Colasante, C.
    (1991) Do conversational hand gestures communicate?Journal of Personality and Social Psychology, 611, 743–754. 10.1037/0022‑3514.61.5.743
    https://doi.org/10.1037/0022-3514.61.5.743 [Google Scholar]
  37. Krauss, R. M., Chen, Y., & Gottesman, R. F.
    (2000) Lexical gestures and lexical access: a process model. InD. McNeill. (Ed.), Language and gesture (pp.261–283). New York: Cambridge University Press. 10.1017/CBO9780511620850.017
    https://doi.org/10.1017/CBO9780511620850.017 [Google Scholar]
  38. Martuzzi, R., van der Zwaag, W., Farthouat, J., Gruetter, R., & Blanke, O.
    (2014) Human finger somatotopy in areas 3b, 1, and 2: a 7T fMRI study using a natural stimulus. Human Brain Mapping, 35 (1), 213–226. 10.1002/hbm.22172
    https://doi.org/10.1002/hbm.22172 [Google Scholar]
  39. McNeill, D.
    (1985) So you think gestures are nonverbal?Psychological Review, 92 (3), 350–371. 10.1037/0033‑295X.92.3.350
    https://doi.org/10.1037/0033-295X.92.3.350 [Google Scholar]
  40. (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
    [Google Scholar]
  41. (2005) Gesture and thought. Chicago: University of Chicago Press. 10.7208/chicago/9780226514642.001.0001
    https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
  42. Morrel-Samuels, P. & Krauss, R. M.
    (1992) Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, and Cognition, 181, 615–623.
    [Google Scholar]
  43. Ng, M. M., Goh, W. D., Yap, M. J., Tse, C. S., & So, W. C.
    (2017) How we think about temporal words: A gestural priming study in English and Chinese. Frontiers in Psychology, 81, 974. 10.3389/fpsyg.2017.00974
    https://doi.org/10.3389/fpsyg.2017.00974 [Google Scholar]
  44. Perea, M. & Rosa, E.
    (2002) The effects of associative and semantic priming in the lexical decision task. Psychological Research, 66 (3), 180–194. 10.1007/s00426‑002‑0086‑5
    https://doi.org/10.1007/s00426-002-0086-5 [Google Scholar]
  45. Schneider, W., Eschmann, A., & Zuccolotto, A.
    (2002) E-Prime user’s guide. Pittsburgh, PA: Psychology Software Tools, Inc.
    [Google Scholar]
  46. Sidhu, D. M., Vigliocco, G., & Pexman, P. M.
    (2020) Effects of iconicity in lexical decision. Language and Cognition, 12 (1), 164–181. 10.1017/langcog.2019.36
    https://doi.org/10.1017/langcog.2019.36 [Google Scholar]
  47. Slobin, D. I.
    (1987) Thinking for speaking. InAnnual Meeting of the Berkeley Linguistics Society, 131, 435–445. 10.3765/bls.v13i0.1826
    https://doi.org/10.3765/bls.v13i0.1826 [Google Scholar]
  48. (1996) From ‘‘thought and language’’ to ‘‘thinking for speaking’’. InJ. J. Gumperz & S. C. Levinson. (Eds.), Rethinking linguistic relativity (pp.70–96). Cambridge: Cambridge University Press.
    [Google Scholar]
  49. So, W. C., Low, A., Yap, D. F., Kheng, E., & Yap, M.
    (2013) Iconic gestures prime words: comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 41, 779. 10.3389/fpsyg.2013.00779
    https://doi.org/10.3389/fpsyg.2013.00779 [Google Scholar]
  50. Vitevitch, M. S. & Luce, P. A.
    (1998) When words compete: Levels of processing in perception of spoken words. Psychological Science, 9 (4), 325–329. 10.1111/1467‑9280.00064
    https://doi.org/10.1111/1467-9280.00064 [Google Scholar]
  51. Wilson, M. & Emmorey, K.
    (2006) No difference in short-term memory span between sign and speech. Psychological Science – Cambridge, 17 (12), 1093–1094. 10.1111/j.1467‑9280.2006.01835.x
    https://doi.org/10.1111/j.1467-9280.2006.01835.x [Google Scholar]
  52. Wilson, M. & Knoblich, G.
    (2005) The case for motor involvement in perceiving conspecifics. Psychological Bulletin, 131 (3), 460–473. 10.1037/0033‑2909.131.3.460
    https://doi.org/10.1037/0033-2909.131.3.460 [Google Scholar]
  53. Wu, Y. C. & Coulson, S.
    (2005) Meaningful gestures: Electrophysiological indices of iconic gesture comprehension. Psychophysiology, 421, 654–667. 10.1111/j.1469‑8986.2005.00356.x
    https://doi.org/10.1111/j.1469-8986.2005.00356.x [Google Scholar]
  54. (2007a) Iconic gestures prime related concepts: An ERP study. Psychonomic Bulletin and Review, 14 (1), 57–63. 10.3758/BF03194028
    https://doi.org/10.3758/BF03194028 [Google Scholar]
  55. (2007b) How iconic gestures enhance communication: An ERP study. Brain and Language, 1011, 234–245. 10.1016/j.bandl.2006.12.003
    https://doi.org/10.1016/j.bandl.2006.12.003 [Google Scholar]
  56. Yap, D. F., So, W. C., Melvin Yap, J. M., Tan, Y. Q., & Teoh, R. L. S.
    (2011) Iconic gestures prime words. Cognitive Science, 35 (1), 171–183. 10.1111/j.1551‑6709.2010.01141.x
    https://doi.org/10.1111/j.1551-6709.2010.01141.x [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/gest.20019.san
Loading
/content/journals/10.1075/gest.20019.san
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): cross-modal priming; iconic gesture; semantic priming; word processing
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error