1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 17, Issue 1
  5. Article
Volume 17, Issue 1
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Events with a motor action component (e.g., handling an object) tend to evoke gestures from the point of view of a character (character viewpoint, or CVPT) while events with a path component (moving through space) tend to evoke gestures from the point of view of an observer (observer viewpoint, or OVPT). Events that combine both components (e.g., rowing a boat across a lake) seem to evoke both types of gesture, but it is unclear why narrators use one or the other. We carry out two manipulations to explore whether gestural viewpoint can be manipulated. Participants read a series of stories and retold them in two conditions. In the image condition, story sentences were presented with images from either the actor’s perspective (actor version) or the observer’s perspective (observer version). In the linguistic condition, the same sentences were presented in either the second person (…) or the third person point of view (…). The second person led participants to use the first person () in retelling. Gestures produced during retelling were coded as CVPT or OVPT. Participants produced significantly more CVPT gestures after seeing images from the point of view of an actor, but the linguistic manipulation did not affect viewpoint in gesture. Neither manipulation affected overall gesture rate, or co-occurring speech. We relate these findings to frameworks in which motor action and mental imagery are linked to viewpoint in gesture.

© John Benjamins
Loading

Article metrics loading...

/content/journals/10.1075/gest.00014.par
2018-10-19
2024-10-05

  • From This Site

    /content/journals/10.1075/gest.00014.par
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Bergen, Benjamin , Shane Lindsay , Teenie Matlock , & Srini Narayanan
    (2007) Spatial and linguistic aspects of visual imagery in sentence comprehension. Cognitive Science, 31, 733–764.10.1080/03640210701530748
     https://doi.org/10.1080/03640210701530748 [Google Scholar]
  2. Borghi, Anna , Arthur Glenberg , & Michael P. Kaschak
    (2004) Putting words in perspective. Memory and Cognition, 32, 863–873.10.3758/BF03196865
     https://doi.org/10.3758/BF03196865 [Google Scholar]
  3. Brown, Amanda
    (2008) Gesture viewpoint in Japanese and English. Gesture, 8 (2), 256–276.10.1075/gest.8.2.08bro
     https://doi.org/10.1075/gest.8.2.08bro [Google Scholar]
  4. Brunyé, Tad T. , Tali Ditman , Caroline R. Mahoney , Jason S. Augustyn , & Holly A. Taylor
    (2009) When you and I share perspectives. Psychological Science, 20, 27–32.10.1111/j.1467‑9280.2008.02249.x
     https://doi.org/10.1111/j.1467-9280.2008.02249.x [Google Scholar]
  5. Crasborn, Onno & Han Sloetjes
    (2008) Enhanced ELAN functionality for sign language corpora. In Onno Crasborn , Thomas Hanke , Eleni Efthimiou , Inge Zwitserlood , & Ernst-Daniel Thoutenhoofd (Eds.), Construction and exploitation of sign language corpora: 3rd workshop on the representation and processing of sign languages (pp.39–43). Paris: ELRA.
     [Google Scholar]
  6. Davis, Joshua Ian , Adam Benforado , Ellen Esrock , Alasdair Turner , Ruth C. Dalton , Leon van Noorden , & Marc Leman
    (2012) Four applications of embodied cognition. Topics in Cognitive Science, 4, 786–793.10.1111/j.1756‑8765.2012.01225.x
     https://doi.org/10.1111/j.1756-8765.2012.01225.x [Google Scholar]
  7. Debreslioska, Sandra , Aslı Özyürek , Marianne Gullberg , & Pamela Perniss
    (2013) Gestural viewpoint signals referent accessibility. Discourse Processes, 50, 431–456.10.1080/0163853X.2013.824286
     https://doi.org/10.1080/0163853X.2013.824286 [Google Scholar]
  8. Deliema, David & Eve Sweetser
    (2016) Rethinking gestural viewpoint as multidimensional rather than a dichotomy. Paper presented atthe International Society for Gesture Studies, Paris, 18–22 July.
     [Google Scholar]
  9. Emmorey, Karen , Barbara Tversky , & Holly A. Taylor
    (2000) Using space to describe space: Perspective in speech, sign, and gesture. Spatial Cognition and Computation, 26, 157–180.10.1023/A:1013118114571
     https://doi.org/10.1023/A:1013118114571 [Google Scholar]
  10. Engberg-Pedersen, Elizabeth
    (2015) Perspective in signed discourse: the privileged status of the signer’s locus and gaze. Open Linguistics, 1, 411–431.10.1515/opli‑2015‑0010
     https://doi.org/10.1515/opli-2015-0010 [Google Scholar]
  11. Frederiksen, Anne Therese
    (2017) Separating viewpoint from mode of representation in iconic co-speech gestures: Insights from Danish narratives. Language and Cognition, 9 (4), 677–708. doi: 10.1017/langcog.2016.35
     https://doi.org/10.1017/langcog.2016.35 [Google Scholar]
  12. Gibbs, Ray
    (2005) Embodiment and cognitive science. Cambridge: Cambridge University Press.10.1017/CBO9780511805844
     https://doi.org/10.1017/CBO9780511805844 [Google Scholar]
  13. Glenberg, Arthur & Michael P. Kaschak
    (2002) Grounding language in action. Psychonomic Bulletin & Review, 96, 558–565.10.3758/BF03196313
     https://doi.org/10.3758/BF03196313 [Google Scholar]
  14. Glenberg, Arthur , Marc Sato , Luigi Cattaneo , Lucia Riggio , Daniele Palumbo , & Giovanni Buccino
    (2013) Processing abstract language modulates motor system activity. Quarterly Journal of Experimental Psychology, 61 (6), 905–919.10.1080/17470210701625550
     https://doi.org/10.1080/17470210701625550 [Google Scholar]
  15. Grezes, Julie , Mary J. Tucker , Jorge L. Armony , Robert R. Eillis , & Richard E. Passingham
    (2003) Objects automatically potentiate action: an fMRI study of implicit processing. European Journal of Neuroscience, 17, 2735–2740.10.1046/j.1460‑9568.2003.02695.x
     https://doi.org/10.1046/j.1460-9568.2003.02695.x [Google Scholar]
  16. Hostetter, Autumn B. & Martha W. Alibali
    (2008) Visible embodiment: Gesture as simulated action. Psychonomic Bulletin & Review, 15, 495–514.10.3758/PBR.15.3.495
     https://doi.org/10.3758/PBR.15.3.495 [Google Scholar]
  17. (2010) Language, gesture, action! A test of the Gesture as Simulated Action framework. Journal of Memory & Language, 63, 245–257.10.1016/j.jml.2010.04.003
     https://doi.org/10.1016/j.jml.2010.04.003 [Google Scholar]
  18. Kaschak, Michael P. & Arthur M. Glenberg
    (2000) Constructing meaning: The role of affordances and grammatical constructions in sentence comprehension. Journal of Memory & Language, 43, 508–529.10.1006/jmla.2000.2705
     https://doi.org/10.1006/jmla.2000.2705 [Google Scholar]
  19. Kosslyn, Stephen
    (2005) Mental images and the brain. Cognitive Neuropsychology, 22, 333–347.10.1080/02643290442000130
     https://doi.org/10.1080/02643290442000130 [Google Scholar]
  20. Kushch, Olga , Carmen Pérez Vidal , Marianne Gullberg , & Pilar Prieto
    (2016) Does viewpoint matter for word recall in second language acquisition?Paper presented atthe International Society for Gesture Studies, Paris, 18–22 July.
     [Google Scholar]
  21. Levin, Beth
    (1993) English verb classes and alternations. Chicago: University of Chicago Press.
     [Google Scholar]
  22. Landis, J. Richard & Gary G. Koch
    (1977) The measurement of observer agreement for categorical data. Biometrics, 33, 159–174.10.2307/2529310
     https://doi.org/10.2307/2529310 [Google Scholar]
  23. Markman, Arthur & Eric Dietrich
    (2000) Extending the classical view of representation. Trends in Cognitive Sciences, 4, 470–471.10.1016/S1364‑6613(00)01559‑X
     https://doi.org/10.1016/S1364-6613(00)01559-X [Google Scholar]
  24. McNeill, David
    (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
     [Google Scholar]
  25. Özyürek, Aslı & Pamela Perniss
    (2011) Event representation in sign language: A crosslinguistic perspective. Event representation in language: Encoding events at the language-cognition interface. In Jürgen Bohnemeyer & Eric Pederson (Eds.), Event representation in language and cognition (pp.84–107). Cambridge: Cambridge University Press.
     [Google Scholar]
  26. Parrill, Fey
    (2009) Dual viewpoint gestures. Gesture, 9 (3), 271–289.10.1075/gest.9.3.01par
     https://doi.org/10.1075/gest.9.3.01par [Google Scholar]
  27. (2010a) The hands are part of the package: Gesture, common ground, and information packaging. In Sally Rice & John Newman (Eds.), Empirical and experimental methods in cognitive/functional research (pp.285–302). Stanford: CSLI Publications.
     [Google Scholar]
  28. (2010b) Viewpoint in speech-gesture integration: Linguistic structure, discourse structure, and event structure. Language and Cognitive Processes, 25, 650–668.10.1080/01690960903424248
     https://doi.org/10.1080/01690960903424248 [Google Scholar]
  29. (2011) The relation between the encoding of motion event information and viewpoint in English-accompanying gestures. Gesture, 11, 61–80.10.1075/gest.11.1.04par
     https://doi.org/10.1075/gest.11.1.04par [Google Scholar]
  30. (2012) Interactions between discourse status and viewpoint in co-speech gesture. In Barbara Dancygier & Eve Sweetser (Eds.), Viewpoint in language: A multimodal perspective (pp.97–112). Cambridge: Cambridge University Press.10.1017/CBO9781139084727.008
     https://doi.org/10.1017/CBO9781139084727.008 [Google Scholar]
  31. Parrill, Fey , Jennifer Bullen , & Huston Hoburg
    (2010) Effects of input modality on speech-gesture integration. Journal of Pragmatics, 42, 3130–3137.10.1016/j.pragma.2010.04.023
     https://doi.org/10.1016/j.pragma.2010.04.023 [Google Scholar]
  32. Perniss, Pamela
    (2007) Achieving spatial coherence in German Sign Language narratives: The use of classifiers and perspective. Lingua, 117, 1315–1338.10.1016/j.lingua.2005.06.013
     https://doi.org/10.1016/j.lingua.2005.06.013 [Google Scholar]
  33. Pulvermüller, Friedemann
    (1999) Words in the brain’s language. Behavioral and Brain Sciences, 22, 253–279, discussion280–336.10.1017/S0140525X9900182X
     https://doi.org/10.1017/S0140525X9900182X [Google Scholar]
  34. Ruby, Perrine & Jean Decety
    (2001) Effect of subjective perspective taking during simulation of action: A PET investigation of agency. Nature Neuroscience, 4, 546–550.10.1038/87510
     https://doi.org/10.1038/87510 [Google Scholar]
  35. Stec, Kashmiri
    (2012) Meaningful shifts: A review of viewpoint markers in co-speech gesture and sign language. Gesture, 12, 327–360.10.1075/gest.12.3.03ste
     https://doi.org/10.1075/gest.12.3.03ste [Google Scholar]
  36. Sweetser, Eve E. & Kashmiri Stec
    (2016) Maintaining multiple viewpoints with gaze. In Barbara Dancygier , Wei-lun Lu , & Arie Verhagen (Eds.), Viewpoint and the fabric of meaning: Form and use of viewpoint tools across languages and modalities (pp.237–258). Berlin: de Gruyter.10.1515/9783110365467‑011
     https://doi.org/10.1515/9783110365467-011 [Google Scholar]
  37. Vogeley, Kai & Gereon R. Fink
    (2003) Neural correlates of the first-person perspective. Trends in Cognitive Sciences, 7, 38–42.10.1016/S1364‑6613(02)00003‑7
     https://doi.org/10.1016/S1364-6613(02)00003-7 [Google Scholar]
  38. Vogeley, Kai , Mark May , Afra Ritzl , Peter Falkai , Karl Zilles , & Gereon R. Fink
    (2004) Neural correlates of first-person perspective as one constituent of human self-consciousness. Journal of Cognitive Neuroscience, 16, 817–827.10.1162/089892904970799
     https://doi.org/10.1162/089892904970799 [Google Scholar]
  39. Yaxley, Richard H. & Rolf A. Zwaan
    (2007) Simulating visibility during language comprehension. Cognition, 105, 229–236.10.1016/j.cognition.2006.09.003
     https://doi.org/10.1016/j.cognition.2006.09.003 [Google Scholar]
  40. Zwaan, Rolf A. , Robert A. Stanfield , & Richard H. Yaxley
    (2002) Language comprehenders mentally represent the shapes of objects. Psychological Science, 136, 168–171.10.1111/1467‑9280.00430
     https://doi.org/10.1111/1467-9280.00430 [Google Scholar]
/content/journals/10.1075/gest.00014.par
Loading
Seeing first person changes gesture but saying first person does not
Gesture 17, 158 (2018); https://doi.org/10.1075/gest.00014.par
/content/journals/10.1075/gest.00014.par
/content/journals/10.1075/gest.00014.par
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): embodiment; gesture; perspective; viewpoint

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error