1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 15, Issue 1
  5. Article
Volume 15, Issue 1
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

This paper presents a study of selected iconic gestures with a view to determining their effects on RT in a task-relevant and a task-irrelevant context. In two experiments, participants were presented with a coloured shape on a computer screen, a spoken statement referring to the presented shape, and a gesture that was task irrelevant. The findings from both experiments show strong support for the assumption that gesture processing is obligatory; irrelevant gestures affected speed of task performance. Furthermore the findings suggest that for slower, more cognitively controlled decisions incongruent gestures have an inhibitory effect, while for faster, more cognitively automated decisions congruent gestures have a facilitatory effect.

© 2016 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.15.1.03fel
2016-05-19
2024-12-13

  • From This Site

    /content/journals/10.1075/gest.15.1.03fel
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Barrett, Lisa F. , Christine D. Wilson-Mendenhall , & Lawrence W. Barsalou
    (2014) A psychological construction account of emotion regulation and dysregulation: The role of situated conceptualizations. In James J. Gross (Ed.), The handbook of emotion regulation (pp. 447–465). New York: Guilford.
     [Google Scholar]
  2. Barsalou, Lawrence W
    (1999) Perceptual symbol systems. Behavioral & Brain Sciences, 22, 577–660.
     [Google Scholar]
  3. Barsalou, Lawrence W. & Katja Wiemer-Hastings
    (2005) Situated abstract concepts. In Diane Pecher & Rolf A. Zwaan (Eds.), Grounding cognition: The role of perception and action in memory, language, and thinking (pp. 129–163). Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511499968.007
     https://doi.org/10.1017/CBO9780511499968.007 [Google Scholar]
  4. Bergen, Benjamin
    (2012) Louder than words: The new science of how the mind makes meaning. New York: Basic Books.
     [Google Scholar]
  5. Bernardis, Paolo , Elena Salillas , & Nicoletta Caramelli
    (2008) Behavioural and neurophysiological evidence of semantic interaction between iconic gestures and words. Cognitive Neuropsychology, 25 (7/8), 1114–1128. doi: 10.1080/02643290801921707
     https://doi.org/10.1080/02643290801921707 [Google Scholar]
  6. Bloem, Ineke , Sylvia van den Boogaard , & Wido La Heij
    (2004) Semantic facilitation and semantic interference in language production: Further evidence for the conceptual selection model of lexical access. Journal of Memory and Language, 51, 307–323. doi: 10.1016/j.jml.2004.05.001
     https://doi.org/10.1016/j.jml.2004.05.001 [Google Scholar]
  7. Damasio, Antonio
    (1999) The feeling of what happens: Body and emotion in the making of consciousness. New York: Harcourt.
     [Google Scholar]
  8. Diederich, Adele & Hans Colonius
    (2015) The time window of multisensory integration: Relating reaction times and judgments of temporal order. Psychological Review 2015, Feb23. Online atwww.academia.edu/9450758/The_time_window_of_multisensory_integration_relating_reaction_times_and_judgments_of_temporal_order, last date of access20 March 2015.
     [Google Scholar]
  9. Gellatly, Angus R.H. & Vernon H. Gregg
    (1974) The effect of set size on the latency to name words. Acta Psychologica, 38, 93–98. doi: 10.1016/0001‑6918(74)90020‑1
     https://doi.org/10.1016/0001-6918(74)90020-1 [Google Scholar]
  10. Gentner, Dedre , Özyürek, Aslı , Özge Gürcanli , & Susan Goldin-Meadow
    (2013) Spatial language facilitates spatial cognition: Evidence from children who lack language input. Cognition, 127, 318–330. doi: 10.1016/j.cognition.2013.01.003
     https://doi.org/10.1016/j.cognition.2013.01.003 [Google Scholar]
  11. Gibbs, Raymond W
    (2003) Embodied experience and linguistic meaning. Brain & Language, 84, 1–15. doi: 10.1016/S0093‑934X(02)00517‑5
     https://doi.org/10.1016/S0093-934X(02)00517-5 [Google Scholar]
  12. Gibson, James J
    (1979) The ecological approach to visual perception. Hillsday: Erlbaum.
     [Google Scholar]
  13. Glenberg, Arthur M. & Michael P. Kaschak
    (2002) Grounding language in action. Psychonomic Bulleting & Review, 9, 558–565. doi: 10.3758/BF03196313
     https://doi.org/10.3758/BF03196313 [Google Scholar]
  14. Hauk, Olaf , Ingrid Johnsrude , & Friedemann Pulvermueller
    (2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301–307. doi: 10.1016/S0896‑6273(03)00838‑9
     https://doi.org/10.1016/S0896-6273(03)00838-9 [Google Scholar]
  15. Holle, Henning & Thomas C. Gunter
    (2007) The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience, 19 (7), 1175–1192. doi: 10.1162/jocn.2007.19.7.1175
     https://doi.org/10.1162/jocn.2007.19.7.1175 [Google Scholar]
  16. Hostetter, Autumn B. & Martha W. Alibali
    (2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514. doi: 10.3758/PBR.15.3.495
     https://doi.org/10.3758/PBR.15.3.495 [Google Scholar]
  17. Kelly, Spencer D. , Aslı Özyürek , & Eric Maris
    (2010) Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21, 260–267. doi: 10.1177/0956797609357327
     https://doi.org/10.1177/0956797609357327 [Google Scholar]
  18. Kelly, Spencer D. , Peter Creigh , & James Bartolotti
    (2010) Integrating speech and iconic gestures in a Stroop-like task: Evidence for automatic processing. Journal of Cognitive Neuroscience, 22, 683–694. doi: 10.1162/jocn.2009.21254
     https://doi.org/10.1162/jocn.2009.21254 [Google Scholar]
  19. Lakoff, George & Mark Johnson
    (1980) Metaphors we live by. Chicago: University of Chicago Press.
     [Google Scholar]
  20. (1999) Philosophy in the flesh: The embodied mind and its challenge to western thought. New York: Basic Books.
     [Google Scholar]
  21. McNamara, Timothy P
    (2005) Semantic priming: Perspectives from memory and word recognition. New York: Psychology Press. doi: 10.4324/9780203338001
     https://doi.org/10.4324/9780203338001 [Google Scholar]
  22. Mayr, Susanne & Alex Buchner
    (2007) Negative priming as a memory phenomenon. A review of 20 years of negative priming research. Zeitschrift für Psychologie, 215 (1), 35–51. doi: 10.1027/0044‑3409.215.1.35
     https://doi.org/10.1027/0044-3409.215.1.35 [Google Scholar]
  23. Metta, Giorgio , et al
    (2008) The iCub humanoid robot: An open platform for research in embodied cognition. In Raj Madhavan & Elena R. Messina (Eds.), Proceedings of the 8th Workshop on Performance Metrics for Intelligent Systems (pp. 50–56). New York: ACM. doi: 10.1145/1774674.1774683
     https://doi.org/10.1145/1774674.1774683 [Google Scholar]
  24. Neely, James H
    (1991) Semantic priming effects in visual word recognition: A selective review of current findings and theories. In Derek Besner & Glyn W. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp.264–336). Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.
     [Google Scholar]
  25. Neggers, Bas & Harold Bekkering
    (2001) Gaze anchoring to a pointing target is present during the entire pointing movement and is driven by a non-visual signal. Journal of Neurophysiology, 86, 961–970.
     [Google Scholar]
  26. Niebur, Ernst , et al
    (2001) Research, robots, and reality: A statement on current trends in biorobotics. Behavioral and Brain Sciences, 24 (6), 1072–1073. doi: 10.1017/S0140525X01450126
     https://doi.org/10.1017/S0140525X01450126 [Google Scholar]
  27. Obermeier, Christian & Thomas C. Gunter
    (2014) Multisensory integration: The case of a time window of gesture-speech integration. Journal of Cognitive Neuroscience, 27 (2), 292–307. doi: 10.1162/jocn_a_00688
     https://doi.org/10.1162/jocn_a_00688 [Google Scholar]
  28. Pouw, Wim T.J.L . et al
    (2014) Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5, 359. doi: 10.3389/fpsyg.2014.00359
     https://doi.org/10.3389/fpsyg.2014.00359 [Google Scholar]
  29. Prinz, Jesse J. & Lawrence W. Barsalou
    (2000) Steering a course for embodied representation. In Eric Dietrich & Arthur B. Markman (Eds.), Cognitive dynamics: Conceptual and representational change in humans and machines (pp. 51–77). Cambridge, MA: MIT Press.
     [Google Scholar]
  30. Rizzolatti, Giacomo & Laila Craighero
    (2004) The mirror neuron system. Annual Review of Neuroscience, 27, 169–192. doi: 10.1146/annurev.neuro.27.070203.144230
     https://doi.org/10.1146/annurev.neuro.27.070203.144230 [Google Scholar]
  31. Rizzolatti, Giacomo , Luciano Fadiga , Vittorio Gallese , & Leonardo Fogassi
    (1996) Premotor cortex and the recognition of motor actions. Cognitive Brain Research, 3, 131–141. doi: 10.1016/0926‑6410(95)00038‑0
     https://doi.org/10.1016/0926-6410(95)00038-0 [Google Scholar]
  32. Seliger, Herbert
    (1980) Utterance planning and correction behavior: Its function in the grammar construction process for second language learners. In Hans W. Dechert & Manfred Raupach (Eds.), Towards a crosslinguistic assessment of speech production (pp. 87–99). Frankfurt am Main, Germany: Peter Lang.
     [Google Scholar]
  33. So, Wing-Chee , Alvan Low Yi-Feng , De-Fu Yap , Eugene Kheng , & Ju-Min Melvin Yap
    (2013) Iconic gestures prime words: Comparison of priming effects when gestures are presented alone and when they are accompanying speech. Frontiers in Psychology, 4, 779. doi: 10.3389/fpsyg.2013.00779
     https://doi.org/10.3389/fpsyg.2013.00779 [Google Scholar]
  34. Tipper, Steven P
    (1985) The negative priming effect: Inhibitory priming by ignored objects. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 37 (4), 571–590. doi: 10.1080/14640748508400920
     https://doi.org/10.1080/14640748508400920 [Google Scholar]
  35. Tversky, Barbara & Brigitte M. Hard
    (2009) Embodied and disembodied cognition: Spatial perspective taking. Cognition, 110, 124–129. doi: 10.1016/j.cognition.2008.10.008
     https://doi.org/10.1016/j.cognition.2008.10.008 [Google Scholar]
  36. Vacharkulksemsuk, Tanya & Barbara L. Fredrickson
    (2012) Strangers in sync: Achieving embodied rapport through shared movements. Journal of Experimental Social Psychology, 48, 399–402. doi: 10.1016/j.jesp.2011.07.015
     https://doi.org/10.1016/j.jesp.2011.07.015 [Google Scholar]
  37. Vainiger, Dana , Ludovica Labruna , Richard Ivry , & Michal Lavidor
    (2014) Beyond words: Evidence for automatic language–gesture integration of symbolic gestures but not dynamic landscapes. Psychological Research, 78, 55–69. doi: 10.1007/s00426‑012‑0475‑3
     https://doi.org/10.1007/s00426-012-0475-3 [Google Scholar]
  38. van Dantzig, Saskia , René Zeelenberg , & Diane Pecher
    (2009) Unconstraining theories of embodied cognition. Journal of Experimental Social Psychology, 45, 345–351. doi: 10.1016/j.jesp.2008.11.001
     https://doi.org/10.1016/j.jesp.2008.11.001 [Google Scholar]
  39. Yap, De-Fu , Wing-Chee So , Yu-Min Melvin Yap , Tan, Ying-Quan , & Ruo-Li Serene Teoh
    (2011) Iconic gestures prime words. Cognitive Science, 35 (1), 171–183. doi: 10.1111/j.1551‑6709.2010.01141.x
     https://doi.org/10.1111/j.1551-6709.2010.01141.x [Google Scholar]
  40. Ziemke, Tom & Robert Lowe
    (2009) On the role of emotion in embodied cognitive architectures: From organisms to robots. Cognitive Computation, 1 (1), 104–117. doi: 10.1007/s12559‑009‑9012‑0
     https://doi.org/10.1007/s12559-009-9012-0 [Google Scholar]
/content/journals/10.1075/gest.15.1.03fel
Loading
  • Article Type: Research Article
Keyword(s): communication; facilitatory; gesture; inhibitory; obligatory; relevance; speech

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error