1887
  1. Home
  2. e-Journals
  3. Gesture
  4. Volume 16, Issue 2
  5. Article
Volume 16, Issue 2
  • ISSN 1568-1475
  • E-ISSN: 1569-9773
USD
Buy:$35.00 + Taxes

Abstract

Do speakers intend their gestures to communicate? Central as this question is to the study of gesture, researchers cannot seem to agree on the answer. According to one common framing, gestures are an “unwitting” window into the mind ( McNeill, 1992 ); but, according to another common framing, they are designed along with speech to form “composite utterances” ( Enfield, 2009 ). These two framings correspond to two cultures within gesture studies – the first cognitive and the second interactive in orientation – and they appear to make incompatible claims. In this article I attempt to bridge the cultures by developing a distinction between foreground gestures and background gestures. are designed in their particulars to communicate a critical part of the speaker’s message; are not designed in this way. These are two fundamentally different kinds of gesture, not two different ways of framing the same monolithic behavior. Foreground gestures can often be identified by one or more of the following hallmarks: they are produced along with demonstratives; they are produced in the absence of speech; they are co-organized with speaker gaze; and they are produced with conspicuous effort. The distinction between foreground and background gestures helps dissolve the apparent tension between the two cultures: interactional researchers have focused on foreground gestures and elevated them to the status of a prototype, whereas cognitive researchers have done the same with background gestures. The distinction also generates a number of testable predictions about gesture production and understanding, and it opens up new lines of inquiry into gesture across child development and across cultures.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/gest.16.2.02coo
2018-01-12
2023-12-08

  • From This Site

    /content/journals/10.1075/gest.16.2.02coo
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Alibali, Martha W. , Dana C. Heath , & Heather J. Myers
    (2001) Effects of visibility between speaker and listener on gesture production: Some gestures are meant to be seen. Journal of Memory and Language, 44, 169–188. doi: 10.1006/jmla.2000.2752
     https://doi.org/10.1006/jmla.2000.2752 [Google Scholar]
  2. Alibali, Martha W.
    (2005) Gesture in spatial cognition: Expressing, communicating, and thinking about spatial information. Spatial Cognition & Computation, 5 (4), 307–331. doi: 10.1207/s15427633scc0504_2
     https://doi.org/10.1207/s15427633scc0504_2 [Google Scholar]
  3. Bangerter, Adrian
    (2004) Using pointing and describing to achieve joint focus of attention in dialogue. Psychological Science, 15, 415–419. doi: 10.1111/j.0956‑7976.2004.00694.x
     https://doi.org/10.1111/j.0956-7976.2004.00694.x [Google Scholar]
  4. Bangerter, Adrian & Eric Chevalley
    (2007) Pointing and describing in referential communication: When are pointing gestures used to communicate?In Sluis van der Ielka , Mariët Theune , Ehud Reiter , & Emiel Krahmer (Eds.), CTIT Proceedings of the Workshop on Multimodal Output Generation (MOG), 25–26 January 2007, Aberdeen, Scotland (pp.17–28). Enschede, The Netherlands: Universiteit Twente.
     [Google Scholar]
  5. Bavelas, Janet B.
    (1994) Gestures as part of speech: Methodological implications. Research on Language and Social Interaction, 27 (3), 201–221. doi: 10.1207/s15327973rlsi2703_3
     https://doi.org/10.1207/s15327973rlsi2703_3 [Google Scholar]
  6. Bavelas, Janet B. , Jennifer Gerwing , Chantelle Sutton , & Danielle Prevost
    (2008) Gesturing on the telephone: Independent effects of dialogue and visibility. Journal of Memory and Language, 58 (2), 495–520. doi: 10.1016/j.jml.2007.02.004
     https://doi.org/10.1016/j.jml.2007.02.004 [Google Scholar]
  7. Bavelas, Janet B. & Jennifer Gerwing
    (2011) Dyadic evidence for grounding with abstract deictic gestures. In Gale Stam & Mika Ishino (Eds.), Integrating gestures (pp.49–60). Amsterdam: John Benjamins. doi: 10.1075/gs.4.05bav
     https://doi.org/10.1075/gs.4.05bav [Google Scholar]
  8. Brentari, Diane , Marie Coppola , Laura Mazzoni , & Susan Goldin-Meadow
    (2012) When does a system become phonological? Handshape production in gesturers, signers, and homesigners. Natural Language and Linguistic Theory, 30, 1–31. doi: 10.1007/s11049‑011‑9145‑1
     https://doi.org/10.1007/s11049-011-9145-1 [Google Scholar]
  9. Brookes, Heather
    (2004) A repertoire of South African quotable gestures. Journal of Linguistic Anthropology, 14 (2), 186–224. doi: 10.1525/jlin.2004.14.2.186
     https://doi.org/10.1525/jlin.2004.14.2.186 [Google Scholar]
  10. Brooks, Neon , David Barner , Michael Frank , & Susan Goldin-Meadow
    (2017). The role of gesture in supporting mental representations: The case of mental abacus arithmetic. Cognitive Science. doi: 10.1111/cogs.12527.
     https://doi.org/10.1111/cogs.12527 [Google Scholar]
  11. Butterworth, George & Shoji Itakura
    (2000) How the eyes, head and hand serve definite reference. British Journal of Developmental Psychology, 18, 25–50. doi: 10.1348/026151000165553
     https://doi.org/10.1348/026151000165553 [Google Scholar]
  12. Carlson, Richard A. , Mario N. Avraamides , Melanie Cary , & Stephen Strasberg
    (2007) What do the hands externalize in simple arithmetic?Journal of Experimental Psychology: Learning, Memory, and Cognition, 33 (4), 747–56.
     [Google Scholar]
  13. Chu, Mingyuan & Sotaro Kita
    (2008) Spontaneous gestures during mental rotation tasks: insights into the microdevelopment of the motor strategy. Journal of Experimental Psychology. General, 137 (4), 706–23. doi: 10.1037/a0013157
     https://doi.org/10.1037/a0013157 [Google Scholar]
  14. Chu, Mingyuan , & Sotaro Kita
    (2011) The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology: General, 140 (1), 102–16. doi: 10.1037/a0021790
     https://doi.org/10.1037/a0021790 [Google Scholar]
  15. Chu, Mingyuan , Antje Meyer , Lucy Foulkes , & Sotaro Kita
    (2013) Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy. Journal of Experimental Psychology. General, 143 (2), 694–709. doi: 10.1037/a0033861
     https://doi.org/10.1037/a0033861 [Google Scholar]
  16. Clark, Herbert H.
    (1996) Using language. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511620539
     https://doi.org/10.1017/CBO9780511620539 [Google Scholar]
  17. Cooperrider, Kensy
    (2011) Reference in action: Links between pointing and language. Doctoral dissertation, University of California – San Diego.
  18. (2014) Body-directed gestures: Pointing to the self and beyond. Journal of Pragmatics, 71, 1–16. doi: 10.1016/j.pragma.2014.07.003
     https://doi.org/10.1016/j.pragma.2014.07.003 [Google Scholar]
  19. de Ruiter, Jan-Peter
    (2007) Postcards from the mind: The relationship between speech, imagistic gesture, and thought. Gesture, 7 (1), 21–38. doi: 10.1075/gest.7.1.03rui
     https://doi.org/10.1075/gest.7.1.03rui [Google Scholar]
  20. de Ruiter, Jan-Peter & David P. Wilkins
    (1998) The synchronization of gesture and speech in Dutch and Arrernte (an Australian Aboriginal language): A cross-cultural comparison. In Serge Santi (Ed.), Oralité et gestualité (pp.603–607). Paris: Harmattan.
     [Google Scholar]
  21. de Ruiter, Jan-Peter , Adrian Bangerter , & Paula Dings
    (2012) The interplay between gesture and speech in the production of referring expressions: Investigating the tradeoff hypothesis. Topics in Cognitive Science, 4 (2), 232–248. doi: 10.1111/j.1756‑8765.2012.01183.x
     https://doi.org/10.1111/j.1756-8765.2012.01183.x [Google Scholar]
  22. Diessel, Holger
    (1999) Demonstratives: Form, function, and grammaticalization. Amsterdam: John Benjamins. doi: 10.1075/tsl.42
     https://doi.org/10.1075/tsl.42 [Google Scholar]
  23. (2006) Demonstratives, joint attention, and the emergence of grammar. Cognitive Linguistics, 17 (4), 463–489. doi: 10.1515/COG.2006.015
     https://doi.org/10.1515/COG.2006.015 [Google Scholar]
  24. Dixon, Robert M. W.
    (2003) Demonstratives: A cross-linguistic typology. Studies in Language, 27 (1), 61–112. doi: 10.1075/sl.27.1.04dix
     https://doi.org/10.1075/sl.27.1.04dix [Google Scholar]
  25. Ekman, Paul & Wallace V. Friesen
    (1969) The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica, 1 (1), 49–98.
     [Google Scholar]
  26. Emmorey, Karen
    (2002) Language, cognition, and the brain: Insights from sign language research. Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  27. Emmorey, Karen & Shannon Casey
    (2001) Gesture, thought and spatial language. Gesture, 1 (1), 35–50. doi: 10.1075/gest.1.1.04emm
     https://doi.org/10.1075/gest.1.1.04emm [Google Scholar]
  28. Emmorey, Karen , Robin Thompson , & Rachael Colvin
    (2009) Eye gaze during comprehension of American Sign Language by native and beginning signers. Journal of Deaf Studies and Deaf Education, 14, 237–243. doi: 10.1093/deafed/enn037
     https://doi.org/10.1093/deafed/enn037 [Google Scholar]
  29. Enfield, Nicholas J.
    (2004) On linear segmentation and combinatorics in co-speech gesture: A symmetry-dominance construction in Lao fish trap descriptions. Semiotica, 149, 57–123. doi: 10.1515/semi.2004.038
     https://doi.org/10.1515/semi.2004.038 [Google Scholar]
  30. (2009) The anatomy of meaning: Speech, gesture, and composite utterances. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511576737
     https://doi.org/10.1017/CBO9780511576737 [Google Scholar]
  31. Enfield, Nicholas J. , Sotaro Kita , & Jan-Peter de Ruiter
    (2007) Primary and secondary pragmatic functions of pointing gestures. Journal of Pragmatics, 39 (10), 1722–1741. doi: 10.1016/j.pragma.2007.03.001
     https://doi.org/10.1016/j.pragma.2007.03.001 [Google Scholar]
  32. Engle, Randi
    (2000) Toward a theory of multimodal communication: Combining speech, gestures, diagrams, and demonstrations in instructional explanations. Doctoral dissertation, Stanford University.
  33. Floyd, Simeon
    (2016) Modally hybrid grammar? Celestial pointing for time-of-day reference in Nheengatú. Language, 92 (1), 31–64. doi: 10.1353/lan.2016.0013
     https://doi.org/10.1353/lan.2016.0013 [Google Scholar]
  34. Fontana, Sabina
    (2008) Mouth actions as gesture in sign language. Gesture, 8 (1), 104–123. doi: 10.1075/gest.8.1.08fon
     https://doi.org/10.1075/gest.8.1.08fon [Google Scholar]
  35. Forrester, Gillian S. & Alina Rodriguez
    (2015) Slip of the tongue: Implications for evolution and language development. Cognition, 141, 103–111. doi: 10.1016/j.cognition.2015.04.012
     https://doi.org/10.1016/j.cognition.2015.04.012 [Google Scholar]
  36. Garber, Paul , & Susan Goldin-Meadow
    (2002) Gesture offers insight into problem-solving in adults and children. Cognitive Science, 26, 817–831. doi: 10.1207/s15516709cog2606_5
     https://doi.org/10.1207/s15516709cog2606_5 [Google Scholar]
  37. Galati, Alexia & Susan E. Brennan
    (2014) Speakers adapt gestures to addressees’ knowledge: implications for models of co-speech gesture. Language and Cognitive Processes, 29 (4), 435–451.
     [Google Scholar]
  38. Gentilucci, Maurizio , Francesca Benuzzi , Massimo Gangitano , & Silvia Grimaldi
    (2001) Grasp with hand and mouth: A kinematic study on healthy subjects. Journal of Neurophysiology, 86, 1685–1699. doi: 10.1152/jn.2001.86.4.1685
     https://doi.org/10.1152/jn.2001.86.4.1685 [Google Scholar]
  39. Gerwing, Jennifer , & Janet B. Bavelas
    (2004) Linguistic influences on gesture’s form. Gesture, 4 (2), 157–195. doi: 10.1075/gest.4.2.04ger
     https://doi.org/10.1075/gest.4.2.04ger [Google Scholar]
  40. Goldin-Meadow, Susan
    (2003) Hearing gesture: How our hands help us think. Cambridge, MA: Belknap.
     [Google Scholar]
  41. Goldin-Meadow, Susan & Martha W. Alibali
    (2013) Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology, 64, 257–283. doi: 10.1146/annurev‑psych‑113011‑143802
     https://doi.org/10.1146/annurev-psych-113011-143802 [Google Scholar]
  42. Goodwin, Charles
    (1986) Gesture as a resource for the organization of mutual orientation. Semiotica, 62 (1/2), 29–49.
     [Google Scholar]
  43. (1994) Professional vision. American Anthropologist, 96 (3), 606–633. doi: 10.1525/aa.1994.96.3.02a00100
     https://doi.org/10.1525/aa.1994.96.3.02a00100 [Google Scholar]
  44. Guérin, Valérie
    (2015) Demonstrative verbs: A typology of verbal manner deixis. Linguistic Typology, 19 (2), 141–199. doi: 10.1515/lingty‑2015‑0006
     https://doi.org/10.1515/lingty-2015-0006 [Google Scholar]
  45. Gullberg, Marianne , & Kenneth Holmqvist
    (2006) What speakers do and what addressees look at: Visual attention to gestures in human interaction live and on video. Pragmatics & Cognition, 14 (1), 53–82. doi: 10.1075/pc.14.1.05gul
     https://doi.org/10.1075/pc.14.1.05gul [Google Scholar]
  46. Gullberg, Marianne & Sotaro Kita
    (2009) Attention to speech-accompanying gestures: Eye movements and information uptake. Journal of Nonverbal Behavior, 33 (4), 251–277. doi: 10.1007/s10919‑009‑0073‑2
     https://doi.org/10.1007/s10919-009-0073-2 [Google Scholar]
  47. Haviland, John B.
    (2004) Gesture. In Alessandro Duranti (Ed.), A Companion to Linguistic Anthropology (pp.197–221). Oxford: Blackwell.
     [Google Scholar]
  48. Hostetter, Autumn B.
    (2014) Action attenuates the effect of visibility on gesture rates. Cognitive Science, 38 (7), 1468–1481. doi: 10.1111/cogs.12113
     https://doi.org/10.1111/cogs.12113 [Google Scholar]
  49. Hostetter, Autumn B. & Martha W. Alibali
    (2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15 (3), 495–514. doi: 10.3758/PBR.15.3.495
     https://doi.org/10.3758/PBR.15.3.495 [Google Scholar]
  50. Iverson, Jana M. & Susan Goldin-Meadow
    (1998) Why people gesture when they speak. Nature, 396 (6708), 228. doi: 10.1038/24300
     https://doi.org/10.1038/24300 [Google Scholar]
  51. Iverson, Jana M. & Esther Thelen
    (1999) Hand, mouth, and brain: The dynamic emergence of speech and gesture. In Rafael Núñez & Walter J. Freeman (Eds.), Reclaiming cognition: The primacy of action, intention and emotion (pp.19–40). Thorverton: Imprint Academic.
     [Google Scholar]
  52. Kendon, Adam
    (1988) How gestures can become like words. In Fernando Poyatos (Ed.), Cross-cultural perspectives in nonverbal communication (pp.131–141). Toronto: Hogrefe.
     [Google Scholar]
  53. (1990) On some human greetings. In Adam Kendon , Conducting interaction: Patterns of behavior in focused encounters (pp.153–207). Cambridge: Cambridge University Press.
     [Google Scholar]
  54. (1995) Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23 (3), 247–279. doi: 10.1016/0378‑2166(94)00037‑F
     https://doi.org/10.1016/0378-2166(94)00037-F [Google Scholar]
  55. (2004) Gesture: Visible action as utterance. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511807572
     https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
  56. Kita, Sotaro & James Essegbey
    (2001) Pointing left in Ghana. How a taboo on the use of the left hand influences gestural practice. Gesture, 1 (1), 73–95. doi: 10.1075/gest.1.1.06kit
     https://doi.org/10.1075/gest.1.1.06kit [Google Scholar]
  57. Le Guen, Olivier
    (2011) Speech and gesture in spatial language and cognition among the Yucatec Mayas. Cognitive Science, 35, 905–938. doi: 10.1111/j.1551‑6709.2011.01183.x
     https://doi.org/10.1111/j.1551-6709.2011.01183.x [Google Scholar]
  58. McComsey, Melanie , Kensy Cooperrider , & Tyler Marghetis
    (2016, January). Sources of within-population variability in spatial communication and reasoning: Evidence from Juchitán, Mexico. Presented at theAnnual Meeting of the Linguistic Society of America, Washington, DC.
     [Google Scholar]
  59. McNeill, David
    (1985) So you think gestures are nonverbal?Psychological Review, 92 (3), 350–371. doi: 10.1037/0033‑295X.92.3.350
     https://doi.org/10.1037/0033-295X.92.3.350 [Google Scholar]
  60. (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
     [Google Scholar]
  61. (2000) Introduction. In David McNeill (Ed.), Language and gesture (pp.1–10). Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511620850.001
     https://doi.org/10.1017/CBO9780511620850.001 [Google Scholar]
  62. (2005) Gesture and thought. Chicago: University of Chicago Press. doi: 10.7208/chicago/9780226514642.001.0001
     https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
  63. McNeill, David , Justine Cassell , & Elena T. Levy
    (1993) Abstract deixis. Semiotica, 95 (1/2), 5–20.
     [Google Scholar]
  64. McNeill, David
    (2014) Gesture – speech unity: Phylogenesis, ontogenesis, and microgenesis. Language, Interaction and Acquisition, 5 (2), 137–184. doi: 10.1075/lia.5.2.01mcn
     https://doi.org/10.1075/lia.5.2.01mcn [Google Scholar]
  65. Meissner, Martin & Stuart B. Philpott
    (1975) The sign language of sawmill workers in British Columbia. Sign Language Studies, 9 (1), 291–308. doi: 10.1353/sls.1975.0010
     https://doi.org/10.1353/sls.1975.0010 [Google Scholar]
  66. Oben, Bert , & Geert Brône
    (2015) What you see is what you do. On the relationship between gaze and gesture in multimodal alignment. Language and Cognition, 7, 546–562. doi: 10.1017/langcog.2015.22
     https://doi.org/10.1017/langcog.2015.22 [Google Scholar]
  67. Rimé, Bernard , & Loris Schiaratura
    (1991) Gesture and speech. In Robert S. Feldman (Ed.), Fundamentals of nonverbal behavior (pp.239–281). New York: Cambridge University Press.
     [Google Scholar]
  68. Sandler, Wendy
    (2009) Symbiotic symbolization by hand and mouth in sign language. Semiotica, 2009 (174), 241–275. doi: 10.1515/semi.2009.035
     https://doi.org/10.1515/semi.2009.035 [Google Scholar]
  69. Sidnell, Jack
    (2005) Gesture in the pursuit and display of recognition: A Caribbean case study. Semiotica, 2005 (156), 55–87. doi: 10.1515/semi.2005.2005.156.55
     https://doi.org/10.1515/semi.2005.2005.156.55 [Google Scholar]
  70. Slama-Cazacu, Tatiana
    (1976) Nonverbal components in message sequence: “Mixed syntax”. In William C. McCormack & Stephen A. Wurm (Eds.), Language and man: Anthropological issues (pp.217–227). The Hague: Mouton.
     [Google Scholar]
  71. Slonimska, Anita , Aslı Özyürek , & Emanuela Campisi
    (2015) Ostensive signals: markers of communicative relevance of gesture during multimodal demonstrations to adults and children. In Gaëlle Ferré & Mark Tutton (Eds.), Proceedings of the 4th GESPIN Conference (pp.217–222). Nantes: Université de Nantes.
     [Google Scholar]
  72. Snow, Charles Percy
    (1959) The two cultures and the scientific revolution. Cambridge: Cambridge University Press.
     [Google Scholar]
  73. Streeck, Jürgen
    (1993) Gesture as communication I: Its coordination with gaze and speech. Communication Monographs, 60, 275–299. doi: 10.1080/03637759309376314
     https://doi.org/10.1080/03637759309376314 [Google Scholar]
  74. (2009) Gesturecraft: The manu-facture of meaning. Amsterdam & Philadelphia: John Benjamins. doi: 10.1075/gs.2
     https://doi.org/10.1075/gs.2 [Google Scholar]
  75. Tuite, Kevin
    (1993) The production of gesture. Semiotica, 93 (1/2), 83–105.
     [Google Scholar]
  76. Wharton, Tim
    (2009) Pragmatics and non-verbal communication. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511635649
     https://doi.org/10.1017/CBO9780511635649 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/gest.16.2.02coo
Loading
Foreground gesture, background gesture
Gesture 16, 176 (2017); https://doi.org/10.1075/gest.16.2.02coo
/content/journals/10.1075/gest.16.2.02coo
/content/journals/10.1075/gest.16.2.02coo
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): communication; demonstratives; effort; gaze; gesture; language

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error