1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 17, Issue 3
  5. Article
Volume 17, Issue 3
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This paper proposes a novel analysis of deictic gestures which yields a taxonomy of manual pointing. ‘Gesture form analysis’ brings into relief the diversity of pointing by considering the imaginary forms necessarily involved in interpreting a gesture. It combines into a single framework insights found in the literature on how the meaning of any gesture is enabled by a series of spatial operations leading from the physical form of the articulators to the form of the target. Seven distinct spatial operations combine to define a gesture type, twenty-seven of which are illustrated with examples from open-data corpora. Most types involve not the prototypical linear vector of pointing, but the plane of an open hand. Not only deictic, but also iconic and other functions are shown to be rooted in imaginary forms and their ability to draw attention to and specify locations, directions, areas and volumes of space.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.17018.has
2020-02-18
2024-12-02

  • From This Site

    /content/journals/10.1075/gest.17018.has
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Andrén, Mats
    (2010) Children’s gestures from 18 to 30 months. Doctoral Dissertation, Lund University.
  2. Arnheim, Rudolf
    (2004 [1969]) Visual thinking. Berkeley: University of California Press.
     [Google Scholar]
  3. Bühler, Karl
    (2000 [1934]) Sprachtheorie. InLudger Hoffmann (Ed.), Sprachwissenschaft. Ein Reader (2nd Ed., pp.51–71). Berlin: Walter de Gruyter.
     [Google Scholar]
  4. Butterworth, George
    (2003) Pointing is the royal road to language for babies. InSotaro Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp.9–34). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  5. Clark, Herbert H.
    (1996) Using language. Cambridge: Cambridge University Press. 10.1017/CBO9780511620539
     https://doi.org/10.1017/CBO9780511620539 [Google Scholar]
  6. Clark, Herbert H., Robert Schreuder, Samuel Buttrick
    (1983) Common ground and the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior, 22 (2), 245–258. 10.1016/S0022‑5371(83)90189‑5
     https://doi.org/10.1016/S0022-5371(83)90189-5 [Google Scholar]
  7. Cooperrider, Kensy A.
    (2011) Reference in action: Links between pointing and language. PhD Dissertation, University of California San Diego.
  8. (2014) Body-directed gestures: Pointing to the self and beyond. Journal of Pragmatics, 71, 1–16. 10.1016/j.pragma.2014.07.003
     https://doi.org/10.1016/j.pragma.2014.07.003 [Google Scholar]
  9. Deacon, Terrence W.
    (1997) The symbolic species: The co-evolution of language and the brain. New York & London: W. W. Norton and Company.
     [Google Scholar]
  10. Enfield, Nick J.
    (2001) Lip-pointing: A discussion of form and function with reference to data from Laos. Gesture, 1 (2), 185–211. 10.1075/gest.1.2.06enf
     https://doi.org/10.1075/gest.1.2.06enf [Google Scholar]
  11. (2009) The Anatomy of Meaning. Speech, gesture, and composite utterances. Cambridge & New York: Cambridge University Press. 10.1017/CBO9780511576737
     https://doi.org/10.1017/CBO9780511576737 [Google Scholar]
  12. Fricke, Ellen
    (2007) Origo, Geste und Raum. Lokaldeixis im Deutschen. Berlin/New York: Walter de Gruyter. 10.1515/9783110897746
     https://doi.org/10.1515/9783110897746 [Google Scholar]
  13. Gibson, James J.
    (1977) The theory of affordances. InRobert Shaw (Ed.), Perceiving, acting, and knowing. Towards an ecological psychology (pp.67–82). Hillsdale, NJ: Lawrence Erlbaum.
     [Google Scholar]
  14. Goodwin, Charles
    (2003) Pointing as situated practice. InSotaro Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp.217–242). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  15. (2018) Co-operative action. Cambridge: Cambridge University Press.
     [Google Scholar]
  16. Hassemer, Julius
    (2009) Chief pointing-eye. Multiarticulatory metaphorical gestures expressing high. MA thesis, European University Viadrina, Frankfurt (Oder). 10.2139/ssrn.1507135
     https://doi.org/10.2139/ssrn.1507135
  17. (2016) Towards a theory of gesture form analysis. Imaginary forms as part of gesture conceptualisation, with empirical support from motion-capture data. Doctoral Dissertation, RWTH Aachen University.
  18. Hassemer, Julius, Gina Joue, Klaus Willmes, & Irene Mittelberg
    (2011) Dimensions and mechanisms of form constitution: Towards a formal description of gestures. InProceedings of Gesture and Speech in Interaction (GESPIN) 2011. Bielefeld.
     [Google Scholar]
  19. Hassemer, Julius, Cornelia Müller, & Irene Mittelberg
    (2010) Marker analysis: Geometrical dimensions of gesture form. In4th Conference of the International Society of Gesture Studies (ISGS4). July25–30, Frankfurt (Oder).
     [Google Scholar]
  20. Hassemer, Julius & Bodo Winter
    (2016) Producing and perceiving gestures conveying height or shape. Gesture, 15 (3), 404–424. 10.1075/gest.15.3.07has
     https://doi.org/10.1075/gest.15.3.07has [Google Scholar]
  21. (2018) Decoding gestural iconicity. Cognitive Science, 42 (8), 3034–3049. doi:  10.1111/cogs.12680
     https://doi.org/10.1111/cogs.12680 [Google Scholar]
  22. Haviland, John B.
    (2003) How to point in Zinacantán. InSotaro Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp.139–170). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  23. James, William
    (1890) The principles of psychology, Vol.2. New York: Henry Holt.
     [Google Scholar]
  24. Kendon, Adam
    (1988) Goffman’s approach to face-to-face Interaction. InPaul Drew & Anthony Wootton (Eds.), Erving Goffman. Exploring the interaction order (pp.14–40). Boston: Northeastern University Press.
     [Google Scholar]
  25. (2004) Gesture: Visible action as utterance. Cambridge & New York: Cambridge University Press. 10.1017/CBO9780511807572
     https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
  26. Kendon, Adam & Laura Versante
    (2003) Pointing by hand in “Neapolitan”. InSotaro Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp.109–138). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  27. Kita, Sotaro
    (2003) Pointing: Where language, culture, and cognition meet. Mahwah, NJ: Lawrence Erlbaum. 10.4324/9781410607744
     https://doi.org/10.4324/9781410607744 [Google Scholar]
  28. Kita, Sotaro & Hedda Lausberg
    (2008) Generation of co-speech gestures based on spatial imagery from the right-hemisphere: Evidence from split-brain patients. Cortex, 44, 131–39. 10.1016/j.cortex.2006.04.001
     https://doi.org/10.1016/j.cortex.2006.04.001 [Google Scholar]
  29. Koffka, Kurt
    (1936) Principles of Gestalt psychology. New York: Harcourt Brace.
     [Google Scholar]
  30. Kranstedt, Alfred, Andy Lücking, Thies Pfeiffer, Hannes Rieser, & Marc Staudacher
    (2006) Measuring and reconstructing pointing in visual contexts. InProceedings of the Brandial 2006 – The 10th Workshop on the Semantics and Pragmatics of Dialogue (pp.82–89). Potsdam: Universitätsverlag.
     [Google Scholar]
  31. Lausberg, Hedda & Han Sloetjes
    (2009) Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, 41 (3), 841–849. 10.3758/BRM.41.3.841
     https://doi.org/10.3758/BRM.41.3.841 [Google Scholar]
  32. Le Guen, Olivier
    (2011) Modes of pointing to existing spaces and the use of frames of reference. Gesture, 11 (3), 271–307. 10.1075/gest.11.3.02leg
     https://doi.org/10.1075/gest.11.3.02leg [Google Scholar]
  33. Liddell, Scott K.
    (2003) Grammar, gesture, and meaning in American Sign Language. Cambridge: Cambridge University Press. 10.1017/CBO9780511615054
     https://doi.org/10.1017/CBO9780511615054 [Google Scholar]
  34. Lücking, Andy, Kirsten Bergmann, Florian Hahn, Stefan Kopp, & Hannes Rieser
    (2010) The Bielefeld Speech and Gesture Alignment Corpus (SaGA). In4th Workshop on the Representation and Processing of Sign Languages (LREC 2010): Corpora and Sign Language Technologies. University of Hamburg.
     [Google Scholar]
  35. Mandel, Mark A.
    (1977) Iconic devices in American Sign Language. InLynn A. Friedman (Ed.), On the other hand: New perspectives on American Sign Language (pp.57–107). New York: Academic Press.
     [Google Scholar]
  36. McNeill, David
    (1992) Hand and mind: What gestures reveal about thought. Chicago: The University of Chicago Press.
     [Google Scholar]
  37. Mittelberg, Irene & Linda R. Waugh
    (2009) Metonymy first, metaphor second: A cognitive-semiotic approach to multimodal figures of thought in co-speech gesture. InCharles Forceville & Eduardo Urios-Aparisi (Eds.), Multimodal metaphor (pp.329–356). Berlin & New York: Mouton de Gruyter.
     [Google Scholar]
  38. Müller, Cornelia
    (1998) Redebegleitende Gesten. Kulturgeschichte – Theorie – Sprachvergleich. Berlin: Arno Spitz.
     [Google Scholar]
  39. (2008) What gestures reveal about the nature of metaphor. InAlan Cienki & Cornelia Müller (Eds.), Metaphor and gesture (pp.219–245). Amsterdam & Philadelphia: John Benjamins. 10.1075/gs.3.12mul
     https://doi.org/10.1075/gs.3.12mul [Google Scholar]
  40. (2014) Gestural modes of representation as techniques of depiction. InCornelia Müller, Alan Cienki, Ellen Fricke, Silva H. Ladewig, David McNeill, & Jana Bressem (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (Vol.2, pp.1687–1702). Berlin & Boston: Mouton de Gruyter.
     [Google Scholar]
  41. Pfeiffer, Thies
    (2010) Understanding multimodal deixis with gaze and gesture in conversational interfaces. Doctoral Dissertation, Bielefeld University.
  42. Salffner, Sophie
    (2014) Farming, food and yam: language and cultural practices among Ikaan speakers: An archive of language and cultural material from the Akaan people of Ikakumo (Ondo State and Edo State, Nigeria). London: SOAS, Endangered Languages Archive. https://elar.soas.ac.uk/Collection/MPI636676
     [Google Scholar]
  43. Streeck, Jürgen
    (2009) Gesturecraft: The manu-facture of meaning. Amsterdam: John Benjamins. 10.1075/gs.2
     https://doi.org/10.1075/gs.2 [Google Scholar]
  44. Sowa, Timo
    (2006) Understanding coverbal iconic gestures in shape descriptions. Doctoral Dissertation, University of Bielefeld.
  45. Talmy, Leonard
    (2000) Toward a cognitive semantics, Vol. 1: Concept structuring systems. Cambridge: MIT Press.
     [Google Scholar]
  46. (2018) The targeting system of language. Cambridge: MIT Press. 10.7551/mitpress/9780262036979.001.0001
     https://doi.org/10.7551/mitpress/9780262036979.001.0001 [Google Scholar]
  47. Wagemans, Johan, James H. Elder, Michael Kubovy, Stephen E. Palmer, Mary A. Peterson, Manish Singh, & Joachim von der Heydt
    (2012) A century of Gestalt psychology in visual perception I. Perceptual grouping and figure-ground organization. Psychological Bulletin, 138 (6), 1172–1217. 10.1037/a0029333
     https://doi.org/10.1037/a0029333 [Google Scholar]
  48. Wilkins, David P.
    (2003) Why pointing with the index finger is not a universal (in sociocultural and semiotic terms). InSotaro Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp.171–216). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
/content/journals/10.1075/gest.17018.has
Loading
The multidimensionality of pointing
Gesture 17, 417 (2018); https://doi.org/10.1075/gest.17018.has
/content/journals/10.1075/gest.17018.has
/content/journals/10.1075/gest.17018.has
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): classification; deixis; geometry; gesture form; iconicity; imaginary forms; taxonomy

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error