1887
  1. Home
  2. e-Journals
  3. International Journal of Corpus Linguistics
  4. Volume 28, Issue 2
  5. Article
Volume 28, Issue 2
  • ISSN 1384-6655
  • E-ISSN: 1569-9811
USD
Buy:$35.00 + Taxes

Abstract

Abstract

The theories and methods in corpus linguistics (CL) have had an impact on numerous areas in applied linguistics. However, the interface between CL and multimodal speech-gesture studies remains underexplored. One fundamental question is whether it is possible, and even appropriate, to apply the theories and paradigms established based on textual data to multimodal data. To explore this, we examine how CL can assist investigating lexico-grammatical patterns of speech co-occurring with a recurrent gesture (i.e. the circular gesture). Sinclair’s (1996) unit of meaning model is used to describe the co-gestural speech patterns. The study draws on a subset of the Nottingham Multimodal Corpus, in which 570 instances of circular gestures and their co-occurring speech are identified and analysed. We argue that Sinclair’s unit of meaning model can be extended to include speech-gesture patterns, and that those descriptions enable a more nuanced understanding of meaning in context.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/ijcl.20174.che
2022-10-13
2024-12-11

  • From This Site

    /content/journals/10.1075/ijcl.20174.che
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Adolphs, S., & Carter, R.
    (2013) Spoken Corpus Linguistics: From Monomodal to Multimodal. Routledge. 10.4324/9780203526149
     https://doi.org/10.4324/9780203526149 [Google Scholar]
  2. Adolphs, S., Brown, B., Carter, R., Crawford, P., & Sahota, O.
    (2004) Applying corpus linguistics in a health care context. Journal of Applied Linguistics, 1(1), 9–28. 10.1558/japl.1.1.9.55871
     https://doi.org/10.1558/japl.1.1.9.55871 [Google Scholar]
  3. Anthony, L.
    (2019) AntConc (Version 3.5.8) [Computer Software]. https://www.laurenceanthony.net/software
     [Google Scholar]
  4. Atkins, S., & Harvey, K.
    (2010) How to use corpus linguistics in the study of health communication. InA. O’Keeffe & M. McCarthy (Eds.), The Routledge Handbook of Corpus Linguistics (pp.605–619). Routledge. 10.4324/9780203856949‑43
     https://doi.org/10.4324/9780203856949-43 [Google Scholar]
  5. Calbris, G.
    (2011) Elements of Meaning in Gesture. John Benjamins. 10.1075/gs.5
     https://doi.org/10.1075/gs.5 [Google Scholar]
  6. Cánovas, C. P., Valenzuela, J., Carrión, D. A., Olza, I., & Ramscar, M.
    (2020) Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions. PLoS ONE, 15(6), 1–18. 10.1371/journal.pone.0233892
     https://doi.org/10.1371/journal.pone.0233892 [Google Scholar]
  7. Chen, Y., Adolphs, S., & Knight, D.
    (2021) Multimodal Discourse Analysis. InJ. Hardy & E. Friginal (Eds.), Routledge Handbook of Corpus Approaches to Discourse Analysis (pp.98–115). Routledge.
     [Google Scholar]
  8. Cienki, A., & Müller, C.
    (2008) Metaphor, gesture, and thought. InR. W. Gibbs (Ed.), The Cambridge Handbook of Metaphor and Thought (pp.483–501). Cambridge University Press. 10.1017/CBO9780511816802.029
     https://doi.org/10.1017/CBO9780511816802.029 [Google Scholar]
  9. Clift, R.
    (2020) Stability and visibility in embodiment: The ‘Palm Up’ in interaction. Journal of Pragmatics, 1691, 190–205. 10.1016/j.pragma.2020.09.005
     https://doi.org/10.1016/j.pragma.2020.09.005 [Google Scholar]
  10. Debras, C.
    (2017) The shrug. Gesture, 16(1), 1–34. 10.1075/gest.16.1.01deb
     https://doi.org/10.1075/gest.16.1.01deb [Google Scholar]
  11. (2021) Multimodal profiles of je (ne) sais pas in spoken French. Journal of Pragmatics, 1821, 42–62. 10.1016/j.pragma.2021.05.018
     https://doi.org/10.1016/j.pragma.2021.05.018 [Google Scholar]
  12. ELAN (Version 6.0) [Computer software]
    ELAN (Version 6.0) [Computer software] (2020) Nijmegen: Max Planck Institute for Psycholinguistics, The Language Archive. https://archive.mpi.nl/tla/elan
  13. Feyaerts, K., Rominger, C., Lackner, H. K., Brône, G., Jehoul, A., Oben, B., & Papousek, I.
    (2022) In your face? Exploring multimodal response patterns involving facial responses to verbal and gestural stance-taking expressions. Journal of Pragmatics, 1901, 6–17. 10.1016/j.pragma.2022.01.002
     https://doi.org/10.1016/j.pragma.2022.01.002 [Google Scholar]
  14. Gullberg, M., & McCafferty, S. G.
    (2008) Introduction to gesture and SLA: Toward an integrated approach. Studies in Second Language Acquisition, 30(02), 133–146. 10.1017/S0272263108080285
     https://doi.org/10.1017/S0272263108080285 [Google Scholar]
  15. Hinnell, J.
    (2018) The multimodal marking of aspect: The case of five periphrastic auxiliary constructions in North American English. Cognitive Linguistics, 29(4), 773–806. 10.1515/cog‑2017‑0009
     https://doi.org/10.1515/cog-2017-0009 [Google Scholar]
  16. Hunston, S.
    (2002) Corpora in Applied Linguistics. Cambridge University Press. 10.1017/CBO9781139524773
     https://doi.org/10.1017/CBO9781139524773 [Google Scholar]
  17. (2007) Semantic prosody revisited. International Journal of Corpus Linguistics, 12(2), 249–268. 10.1075/ijcl.12.2.09hun
     https://doi.org/10.1075/ijcl.12.2.09hun [Google Scholar]
  18. Kendon, A.
    (2004) Gesture: Visible Action as Utterance. Cambridge University Press. 10.1017/CBO9780511807572
     https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
  19. Kita, S.
    (2009) Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes, 24(2), 145–167. 10.1080/01690960802586188
     https://doi.org/10.1080/01690960802586188 [Google Scholar]
  20. Kita, S., van Gijn, I., & van der Hulst, H.
    (1998) Movement phases in signs and co-speech gestures, and their transcription by human coders. InI. Wachsmuth & M. Fröhlich (Eds.), Gesture and Sign Language in Human-Computer Interaction: International Gesture Workshop Bielefeld, Germany, September 17–19, 1997 Proceedings (pp.23–35). Springer. 10.1007/BFb0052986
     https://doi.org/10.1007/BFb0052986 [Google Scholar]
  21. Knight, D.
    (2011) Multimodality and Active Listenership: A Corpus Approach. Bloomsbury.
     [Google Scholar]
  22. Kok, K.
    (2017) Functional and temporal relations between spoken and gestured components of language. International Journal of Corpus Linguistics, 22(1), 1–26. 10.1075/ijcl.22.1.01kok
     https://doi.org/10.1075/ijcl.22.1.01kok [Google Scholar]
  23. Ladewig, S. H.
    (2011) Putting the cyclic gesture on a cognitive basis. CogniTextes, 61. 10.4000/cognitextes.406
     https://doi.org/10.4000/cognitextes.406 [Google Scholar]
  24. (2014) Recurrent gestures. InC. Müller, A. Cienki, F. Ellen, S. H. Ladewig, D. McNeill, & J. Bressem (Eds.), Body – Language – Communication: An International Handbook on Multimodality in Human Interaction (Volume 2) (pp.1558–1574). De Gruyter Mouton.
     [Google Scholar]
  25. Lausberg, H., & Sloetjes, H.
    (2009) Coding gestural behavior with the NEUROGES-ELAN system. Behavior Research Methods, Instruments, & Computers, 41(3), 841–849. 10.3758/BRM.41.3.841
     https://doi.org/10.3758/BRM.41.3.841 [Google Scholar]
  26. Lin, P., & Chen, Y.
    (2020) 5 Multimodality I: Speech, prosody and gesture. InS. Adophs & D. Knight (Eds.), The Routledge Handbook of Digital Humanities (pp.66–84). Routledge. 10.4324/9781003031758‑5
     https://doi.org/10.4324/9781003031758-5 [Google Scholar]
  27. Louw, B.
    (1993) Irony in the text or insincerity in the writer? The diagnostic potential of semantic prosodies. InM. Baker, G. Grancis, & E. Tognini-Bonelli (Eds.), Text and Technology: In Honour of John Sinclair (pp.157–176). John Benjamins. 10.1075/z.64.11lou
     https://doi.org/10.1075/z.64.11lou [Google Scholar]
  28. McNeill, D.
    (2005) Gesture and Thought. The University of Chicago Press. 10.7208/chicago/9780226514642.001.0001
     https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
  29. Mahlberg, M.
    (2013) Corpus Stylistics and Dickens’s Fiction. Routledge. 10.4324/9780203076088
     https://doi.org/10.4324/9780203076088 [Google Scholar]
  30. Müller, C., Bressem, J., & Ladewig, S. H.
    (2013) Towards a grammar of gestures: A form-based view. InC. Müller, A. Cienki, E. Fricke, S. H. Ladewig, D. McNeill, & S. Teßendorf (Eds.), Body-Language-Communication: An International Handbook on Multimodality in Human Interaction (Volume 1) (pp.707–733). De Gruyter Mouton. 10.1515/9783110261318.707
     https://doi.org/10.1515/9783110261318.707 [Google Scholar]
  31. Müller, Cornelia
    (2004) The Palm-Up-Open-Hand. A case of a gesture family?InC. Müller & R. Posner (Eds.), The Semantics and Pragmatics of Everyday Gestures: Proceedings of the Berlin Conference April 1998 (pp.233–256). Weidler.
     [Google Scholar]
  32. Schegloff, E. A.
    (1984) On some gestures’ relation to talk. InJ. M. Atkinson & J. Heritage (Eds.), Structures of Social Action (pp.266–296). Cambridge University Press.
     [Google Scholar]
  33. Sinclair, J.
    (1996) The search for units of meaning. Textus, 9(1), 1000–1032.
     [Google Scholar]
  34. (2004) Trust the Text: Language, Corpus and Discourse. Routledge. 10.4324/9780203594070
     https://doi.org/10.4324/9780203594070 [Google Scholar]
  35. Streeck, J.
    (2009) Gesturecraft: The Manu-facture of Meaning. John Benjamins. 10.1075/gs.2
     https://doi.org/10.1075/gs.2 [Google Scholar]
  36. Zima, E.
    (2017) On the multimodality of [all the way from X PREP Y]. Linguistics Vanguard, 3(s1), 1–12. 10.1515/lingvan‑2016‑0055
     https://doi.org/10.1515/lingvan-2016-0055 [Google Scholar]
/content/journals/10.1075/ijcl.20174.che
Loading
Towards a corpus-based description of speech-gesture units of meaning
International Journal of Corpus Linguistics 28, 172 (2023); https://doi.org/10.1075/ijcl.20174.che
/content/journals/10.1075/ijcl.20174.che
/content/journals/10.1075/ijcl.20174.che
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): circular gestures; co-gestural speech patterns; multimodal corpus analysis; unit of meaning model

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error