1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 15, Issue 3
  5. Article
Volume 15, Issue 3
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

In this paper, we analyze single-handed hold gestures that convey either the height or the shape of an object. The analyses include (1) differentiating which parts of the hands are profiled in each gesture, (2) considering whether these parts are occluded by other fingers, and (3) deriving predictions from (1) and (2) with regard to what hand shape characteristics favor height or shape gestures. In a production experiment, we asked participants to indicate either the height of a small ball or its shape, using only the index finger and the thumb. As predicted, the middle, ring and little finger were more curled in for height gestures. For shape gestures, those three fingers were more raised. In two perception experiments, participants viewed virtual hands from a computer-generated continuum of hand-shape stimuli. We found that if the middle, ring and little finger were more curled in, participants were more likely to interpret a gesture as indicating height. Our results pose new questions with regard to the relation between the physical form of a gesture and the inferred imaginary forms that are involved in deriving meaning from a gesture.

© 2016 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.15.3.07has
2016-11-28
2023-09-27

  • From This Site

    /content/journals/10.1075/gest.15.3.07has
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Andrén, Mats
    (2010) Children’s gestures from 18 to 30 months. Doctoral thesis, Lunds Universitet.
     [Google Scholar]
  2. Beattie, Geoffrey & Heather Shovelton
    (2006) When size really matters: How a single semantic feature is represented in the speech and gesture modalities. Gesture, 6 (1), 63–84. doi: 10.1075/gest.6.1.04bea
     https://doi.org/10.1075/gest.6.1.04bea [Google Scholar]
  3. Bohannon, John
    (2011) Social science for pennies. Science, 334, 307. doi: 10.1126/science.334.6054.307
     https://doi.org/10.1126/science.334.6054.307 [Google Scholar]
  4. Bressem, Jana
    (2013) A linguistic perspective on the notation of form features in gestures. In Cornelia Müller , Alan Cienki , Ellen Fricke , Silva H. Ladewig , David McNeill , & Sedinha Teßendorf (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (vol. 1, pp.1079–1098). Berlin & Boston: Mouton de Gruyter.
     [Google Scholar]
  5. Calbris, Geneviève
    (1990) The semiotics of French gestures. Bloomington: Indiana University Press.
     [Google Scholar]
  6. (2003) From cutting an object to a clear cut analysis: Gesture as the representation of a preconceptual schema linking concrete actions to abstract notions. Gesture, 3 (1), 19–46. doi: 10.1075/gest.3.1.03cal
     https://doi.org/10.1075/gest.3.1.03cal [Google Scholar]
  7. (2011) Elements of meaning in gesture. Amsterdam: John Benjamins. doi: 10.1075/gs.5
     https://doi.org/10.1075/gs.5 [Google Scholar]
  8. Cienki, Alan
    (2005) Image schemas and gesture. In Beate Hampe (Ed.), From perception to meaning: Image schemas in cognitive linguistics (pp.421–442). Berlin: Mouton de Gruyter. doi: 10.1515/9783110197532.5.421
     https://doi.org/10.1515/9783110197532.5.421 [Google Scholar]
  9. Emmorey, Karen & Melissa Herzig
    (2003) Categorical versus gradient properties of classifier constructions in ASL. In Karen Emmorey (Ed.), Perspectives on classifier constructions in signed languages (pp.222–246). Mahwah: Lawrence Erlbaum Associates.
     [Google Scholar]
  10. Gamer, Matthias , Jim Lemon , & Puspendra Singh
    (2012) irr: Various coefficients of interrater reliability and agreement. R package version 0.84.
     [Google Scholar]
  11. Gentleman, Robert & Duncan Temple Lang
    (2007) Statistical analyses and reproducible research. Journal of Computational and Graphical Statistics, 16, 1–23. doi: 10.1198/106186007X178663
     https://doi.org/10.1198/106186007X178663 [Google Scholar]
  12. Hassemer, Julius
    (2016) Towards a theory of gesture form analysis. Imaginary forms as part of gesture conceptualisation, with empirical support from motion-capture data. Doctoral thesis, RWTH Aachen University.
     [Google Scholar]
  13. Hassemer, Julius , Gina Joue , Klaus Willmes , & Irene Mittelberg
    (2011) Dimensions and mechanisms of form constitution: Towards a formal description of gestures. In Proceedings of Gesture and Speech in Interaction (GESPIN) 2011 . Bielefeld.
     [Google Scholar]
  14. Holler, Judith , Heather Shovelton , & Geoffrey Beattie
    (2009) Do iconic hand gestures really contribute to the communication of semantic information in a face-to-face context?Journal of Nonverbal Behavior, 33 (2), 73–88. doi: 10.1007/s10919‑008‑0063‑9
     https://doi.org/10.1007/s10919-008-0063-9 [Google Scholar]
  15. James, William
    (1890) The principles of psychology, Vol. 2. New York: Henry Holt. doi: 10.1037/11059‑000
     https://doi.org/10.1037/11059-000 [Google Scholar]
  16. Kendon, Adam
    (2004) Gesture: Visible action as utterance. Cambridge & New York: Cambridge University Press. doi: 10.1017/CBO9780511807572
     https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
  17. Kita, Sotaro , Ingeborg van Gijn , & Harry van der Hulst
    (1998) Movement phases in signs and co-speech gestures, and their transcription by human coders. In Ipke Wachsmuth & Martin Fröhlich (Eds.), Gesture and sign language in human-computer interaction. Proceedings of the international gesture workshop, september 17–19, 1997. Lecture notes in artificial intelligence (Vol. 1371, pp.23–35). Berlin & Heidelberg: Springer.
     [Google Scholar]
  18. Landis, J. Richard & Gary G. Koch
    (1977) The measurement of observer agreement for categorical data. Biometrics, 33 (1), 159–174. doi: 10.2307/2529310
     https://doi.org/10.2307/2529310 [Google Scholar]
  19. Lempert, Michael
    (2011) Barack Obama, being sharp: Indexical order in the pragmatics of precision-grip gesture. Gesture, 11 (3), 241–270. doi: 10.1075/gest.11.3.01lem
     https://doi.org/10.1075/gest.11.3.01lem [Google Scholar]
  20. Liberman, Alvin M. , Katherine Safford Harris , Howard S. Hoffman , & Belver C. Griffith
    (1957) The discrimination of speech sounds within and across phoneme boundaries. Journal of Experimental Psychology, 54, 358–368. doi: 10.1037/h0044417
     https://doi.org/10.1037/h0044417 [Google Scholar]
  21. Maechler, Martin
    (2015) diptest: Hartigan’s Dip test statistic for unimodality – corrected. R package version 0.75-7.
     [Google Scholar]
  22. Mandel, Mark Alan
    (1977) Iconic devices in American Sign Language. In Lynn A. Friedman (Ed.), On the other hand: New perspectives on American Sign Language (pp.57–107). New York: Academic Press.
     [Google Scholar]
  23. McNeill, David
    (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
     [Google Scholar]
  24. Mesirov, Jill P
    (2010) Computer science. Accessible reproducible research. Science, 327, 5964. doi: 10.1126/science.1179653
     https://doi.org/10.1126/science.1179653 [Google Scholar]
  25. Mittelberg, Irene
    (2010) Geometric and image-schematic patterns in gesture space. In Vyvyan Evans & Paul Chilton (Eds.), Language, cognition, and space: The state of the art and new directions (pp.351–385). London: Equinox.
     [Google Scholar]
  26. Mittelberg, Irene & Linda R. Waugh
    (2009) Metonymy first, metaphor second: A cognitive-semiotic approach to multimodal figures of thought in co-speech gesture. In Charles Forceville & Eduardo Urios-Aparisi (Eds.), Multimodal metaphor (pp.329–356). Berlin & New York: Mouton de Gruyter.
     [Google Scholar]
  27. Müller, Cornelia
    (1998) Redebegleitende Gesten. Kulturgeschichte – Theorie – Sprachvergleich. Berlin: Arno Spitz.
     [Google Scholar]
  28. (2008) What gestures reveal about the nature of metaphor. In Alan Cienki & Cornelia Müller (Eds.), Metaphor and gesture (pp.219–245). Amsterdam: John Benjamins. doi: 10.1075/gs.3
     https://doi.org/10.1075/gs.3 [Google Scholar]
  29. (2014) Gestural modes of representation as techniques of depiction. In Cornelia Müller , Alan Cienki , Ellen Fricke , Silva H. Ladewig , David McNeill , & Sedinha Teßendorf (Eds.), Body – language – communication: An international handbook on multimodality in human interaction (vol. 2, pp.1687–1702). Berlin & Boston: Mouton de Gruyter.
     [Google Scholar]
  30. Parker, Ellen M. , Randy L. Diehl , & Keith R. Kluender
    (1986) Trading relations in speech and nonspeech. Perception & Psychophysics, 39(2), 129–142. doi: 10.3758/BF03211495
     https://doi.org/10.3758/BF03211495 [Google Scholar]
  31. Peng, Roger D
    (2011) Reproducible research in computational science. Science, 334, 1226–1227. doi: 10.1126/science.1213847
     https://doi.org/10.1126/science.1213847 [Google Scholar]
  32. R Core Team
    (2014) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URLwww.R-project.org/
  33. Repp, Bruno H
    (1982) Phonetic trading relations and context effects: New experimental evidence for a speech mode of perception. Psychological Bulletin, 92 (1), 81–110. doi: 10.1037/0033‑2909.92.1.81
     https://doi.org/10.1037/0033-2909.92.1.81 [Google Scholar]
  34. Sowa, Timo
    (2006) Understanding coverbal iconic gestures in shape descriptions. Doctoral thesis, University of Bielefeld.
     [Google Scholar]
  35. Sprouse, Jon
    (2011) A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory. Behavior Research Methods, 43, 155–167. doi: 10.3758/s13428‑010‑0039‑7
     https://doi.org/10.3758/s13428-010-0039-7 [Google Scholar]
  36. Stokoe, William C
    (2005/1960) Sign language structure: An outline of the visual communication systems of the American deaf. Journal of Deaf Studies and Deaf Education, 10 (1), 3–37. doi: 10.1093/deafed/eni001
     https://doi.org/10.1093/deafed/eni001 [Google Scholar]
  37. Streeck, Jürgen
    (2008) Depicting by gesture. Gesture, 8 (3), 285–301. doi: 10.1075/gest.8.3.02str
     https://doi.org/10.1075/gest.8.3.02str [Google Scholar]
  38. (2009) Gesturecraft: The manu-facture of meaning. Amsterdam: John Benjamins. doi: 10.1075/gs.2
     https://doi.org/10.1075/gs.2 [Google Scholar]
  39. Talmy, Leonard
    (Forthcoming). The targeting system of language. MIT Press.
     [Google Scholar]
  40. Winter, Bodo , Marcus Perlman , & Teenie Matlock
    (2013) Using space to talk and gesture about numbers: Evidence from the TV News Archive. Gesture, 13 (3), 377–408.
     [Google Scholar]
  41. Zwitserlood, Inge
    (2012) Classifiers. In Roland Pfau , Markus Steinbach , & Bencie Woll (Eds.), Sign language: An international handbook (pp.158–186). Berlin & Boston: De Gruyter.
     [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/gest.15.3.07has
Loading
  • Article Type: Research Article
Keyword(s): gesture perception; hand shape; iconicity; precision grip; representational gestures

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error