1887
Volume 22, Issue 2
  • ISSN 1387-6759
  • E-ISSN: 1569-9897

Abstract

Abstract

Users of signed and spoken languages regularly engage bodily enactment (commonly referred to as [CA] for signers and [CVPT] for speakers) for the creation of meaning, but comparatively few studies have addressed how linguistic grammar interfaces with such gestural depictive devices across language modalities. CVPT gestures have been shown to co-occur with spoken language transitive verbs, and when a reference is definite or more accessible in the discourse. In sign, CA often alternates sequentially with fully conventionalized signs. In both CVPT and CA demonstrations, syntactic and pragmatic factors appear to be important. In this work, we consider these patterns by examining short retellings of video-based elicitation stimuli (silent-movie segments) from 10 deaf users of ASL (American Sign Language) and 20 hearing speakers of English. We describe examples of signs and words that co-occur with or precede specific instances of CA and CVPT. We also examine distributions and degrees of enactment across participants in order to consider the question of gesture threshold (Hostetter and Alibali, 20082019). We provide various examples of how gestural material interfaces with linguistic grammar, which has implications for syntactic theory and possible grammatical constraints on such communicative devices.

Available under the CC BY-NC 4.0 license.
Loading

Article metrics loading...

/content/journals/10.1075/lic.00023.qui
2022-06-15
2024-12-05
Loading full text...

Full text loading...

/deliver/fulltext/lic.00023.qui.html?itemId=/content/journals/10.1075/lic.00023.qui&mimeType=html&fmt=ahah

References

  1. Aarons, D. and Morgan, R.
    2003 Classifier Predicates and the Creation of Multiple Perspectives in South African Sign Language. Sign Language Studies3(2): 125–156. 10.1353/sls.2003.0001
    https://doi.org/10.1353/sls.2003.0001 [Google Scholar]
  2. 2000 The Interaction of Classifiers and Syntax in South African Sign Language. Stellenbosch Papers in Linguistics33: 1–20.
    [Google Scholar]
  3. Bressem, J., Ladewig, S. and Müller, C.
    2018 Ways of Expressing Action in Multimodal Narrations – The Semiotic Complexity of Character Viewpoint Depictions. InLinguistic Foundations of Narration in Spoken and Sign Languages, A. Hübl and M. Steinbach (eds), 223–249. Amsterdam: John Benjamins. 10.1075/la.247.10bre
    https://doi.org/10.1075/la.247.10bre [Google Scholar]
  4. Casey, S., Emmorey, K. and Larrabee, H.
    2012 The Effects of Learning American Sign Language on Co-Speech Gesture. Bilingualism: Language and Cognition15(4): 677–686. 10.1017/S1366728911000575
    https://doi.org/10.1017/S1366728911000575 [Google Scholar]
  5. Clark, H. H.
    1996Using Language. Cambridge: Cambridge University Press. 10.1017/CBO9780511620539
    https://doi.org/10.1017/CBO9780511620539 [Google Scholar]
  6. Clark, H. H. and Gerrig, R. J.
    1990 Quotations as Demonstrations. Language66(4): 764–805. 10.2307/414729
    https://doi.org/10.2307/414729 [Google Scholar]
  7. Cormier, K., Smith, S. and Zwets, M.
    2015 Rethinking Constructed Action. Sign Language & Linguistics18(2): 167–204. 10.1075/sll.18.2.01cor
    https://doi.org/10.1075/sll.18.2.01cor [Google Scholar]
  8. Cormier, K., Quinto-Pozos, D., Sevcikova, Z. and Schembri, A.
    2012 Lexicalization and De-Lexicalization Processes in Sign Languages: Comparing Depicting Constructions and Viewpoint Gestures. Language and Communication32(4): 329–348. 10.1016/j.langcom.2012.09.004
    https://doi.org/10.1016/j.langcom.2012.09.004 [Google Scholar]
  9. Cormier, K., Smith, S. and Zwets, M.
    2013 Framing Constructed Action in BSL Narratives. Journal of Pragmatics55: 119–139. 10.1016/j.pragma.2013.06.002
    https://doi.org/10.1016/j.pragma.2013.06.002 [Google Scholar]
  10. Davidson, K.
    2015 Quotation, Demonstration, and Iconicity. Linguistics and Philosophy38(6): 477–520. 10.1007/s10988‑015‑9180‑1
    https://doi.org/10.1007/s10988-015-9180-1 [Google Scholar]
  11. Debreslioska, S. and Gullberg, M.
    2019 Discourse Reference is Bimodal: How Information Status in Speech Interacts with Presence and Viewpoint of Gestures. Discourse Processes56(1): 41–60. 10.1080/0163853X.2017.1351909
    https://doi.org/10.1080/0163853X.2017.1351909 [Google Scholar]
  12. Debreslioska, S., Özyürek, A., Gullberg, M. and Perniss, P.
    2013 Gestural Viewpoint Signals Referent Accessibility. Discourse Processes50(7): 431–456. 10.1080/0163853X.2013.824286
    https://doi.org/10.1080/0163853X.2013.824286 [Google Scholar]
  13. Diefenbach, C., Rieger, M., Massen, C. and Prinz, W.
    2013 Action-Sentence Compatibility: The Role of Action Effects and Timing. Frontiers in Psychology4(272): 1664–1078. 10.3389/fpsyg.2013.00272
    https://doi.org/10.3389/fpsyg.2013.00272 [Google Scholar]
  14. Deliema, D. and Sweetser, E.
    2016 Rethinking Gestural Viewpoint as Multidimensional rather than a Dichotomy. Paper presented at theEighth International Society for Gesture Studies Conference (ISGS), Paris, France, 18–22 July 2016.
    [Google Scholar]
  15. Earis, H. and Cormier, K.
    (2013) Point of View in British Sign Language and Spoken English Narrative Discourse: The Example of “The Tortoise and the Hare”. Language and Cognition5(4): 313–343. 10.1515/langcog‑2013‑0021
    https://doi.org/10.1515/langcog-2013-0021 [Google Scholar]
  16. ELAN (Version 6.2)
    ELAN (Version 6.2) 2021 Nijmegen: Max Planck Institute for Psycholinguistics, The Language Archive. Available athttps://archive.mpi.nl/tla/elan
  17. Ferrara, L. and Hodge, G.
    2018 Language as Description, Indication, and Depiction. Frontiers in Psychology9(716): 1–15. 10.3389/fpsyg.2018.00716
    https://doi.org/10.3389/fpsyg.2018.00716 [Google Scholar]
  18. Ferrara, L. and Johnston, T.
    2014 Elaborating who’s what: A Study of Enactment and Clause Structure in Auslan (Australian Sign Language). Australian Journal of Linguistics34(2): 193–215. 10.1080/07268602.2014.887405
    https://doi.org/10.1080/07268602.2014.887405 [Google Scholar]
  19. Frederiksen, A. and Mayberry, R.
    2016 Who’s on First? Investigating the Referential Hierarchy in Simple Native ASL Narratives. Lingua180: 49–68. 10.1016/j.lingua.2016.03.007
    https://doi.org/10.1016/j.lingua.2016.03.007 [Google Scholar]
  20. Hodge, G. and Cormier, K.
    2018 Reported Speech as Enactment. Linguistic Typology29(1): 185–196. 10.1515/lingty‑2019‑0008
    https://doi.org/10.1515/lingty-2019-0008 [Google Scholar]
  21. Hodge, G., Ferrara, L. and Anible, D.
    2019 The Semiotic Diversity of Doing Reference in a Deaf Signed Language. Journal of Pragmatics143: 33–53. 10.1016/j.pragma.2019.01.025
    https://doi.org/10.1016/j.pragma.2019.01.025 [Google Scholar]
  22. Hostetter, A. and Alibali, M. W.
    2008 Visible Embodiment: Gesture as Simulated Action. Psychonomic Bulletin & Review15(3): 495–514. 10.3758/PBR.15.3.495
    https://doi.org/10.3758/PBR.15.3.495 [Google Scholar]
  23. 2019 Gesture as Simulated Action: Revisiting the Framework. Psychonomic Bulletin & Review26: 721–752. 10.3758/s13423‑018‑1548‑0
    https://doi.org/10.3758/s13423-018-1548-0 [Google Scholar]
  24. Jantunen, T.
    2017 Constructed Action, the Clause and the Nature of Syntax in Finnish Sign Language. Open Linguistics3: 65–85. 10.1515/opli‑2017‑0004
    https://doi.org/10.1515/opli-2017-0004 [Google Scholar]
  25. Jantunen, T., de Weerdt, D., Burger, B. and Puupponen, A.
    2020 The More you Move, the More Action You Construct. A Motion Capture Study on Head and Upper-Torso Movements in Constructed Action in Finnish Sign Language Narratives. Gesture19(1): 72–96. 10.1075/gest.19042.jan
    https://doi.org/10.1075/gest.19042.jan [Google Scholar]
  26. Ladewig, S. H.
    2020Integrating Gestures: The Dimension of Multimodality in Cognitive Grammar. Berlin: De Gruyter Mouton. 10.1515/9783110668568
    https://doi.org/10.1515/9783110668568 [Google Scholar]
  27. Liddell, S.
    2003Grammar, Gesture, and Meaning in American Sign Language. Cambridge: Cambridge University Press. 10.1017/CBO9780511615054
    https://doi.org/10.1017/CBO9780511615054 [Google Scholar]
  28. Liddell, S. and Metzger, M.
    1998 Gesture in Sign Language Discourse. Journal of Pragmatics30(6): 657–697. 10.1016/S0378‑2166(98)00061‑7
    https://doi.org/10.1016/S0378-2166(98)00061-7 [Google Scholar]
  29. Lillo-Martin, D.
    1995 The Point of View Predicate in American Sign Language. InLanguage, Gesture, and Space, K. Emmorey and J. Reilly (eds), 155–170. Hillsdale: Lawrence Erlbaum.
    [Google Scholar]
  30. 2012 17. Utterance Reports and Constructed Action. InSign language: An International Handbook, R. Pfau, M. Steinbach and B. Woll (eds), 365–387. Berlin: de Gruyter. 10.1515/9783110261325.365
    https://doi.org/10.1515/9783110261325.365 [Google Scholar]
  31. McKee, R., Schembri, A., McKee, D. and Johnston, T.
    2011 Variable Subject Expression in Australian Sign Language and New Zealand Sign Language. Language Variation and Change23(3): 1–24. 10.1017/S0954394511000123
    https://doi.org/10.1017/S0954394511000123 [Google Scholar]
  32. McNeill, D.
    1992Hand and Mind: What Gestures Reveal about Though. Chicago: University of Chicago Press.
    [Google Scholar]
  33. Metzger, M.
    1995 Constructed Dialogue and Constructed Action in American Sign Language. InSociolinguistics in Deaf Communities, C. Lucas (ed.), 255–271. Washington: Gallaudet University Press.
    [Google Scholar]
  34. Parrill, F.
    2010 Viewpoint in Speech-Gesture Integration: Linguistic Structure, Discourse Structure, and Event Structure. Language and Cognitive Processes25(5): 650–668. 10.1080/01690960903424248
    https://doi.org/10.1080/01690960903424248 [Google Scholar]
  35. 2011 The Relation between the Encoding of Motion Event Information and Viewpoint in English-Accompanying Gestures. Gesture11(1): 61–80. 10.1075/gest.11.1.04par
    https://doi.org/10.1075/gest.11.1.04par [Google Scholar]
  36. 2012 Interactions between the Discourse Status and Viewpoint in Co-Speech Gesture. InViewpoint in Language: A Multimodal Perspective, B. Dancygier and E. E. Sweetser (eds), 97–112. Cambridge: Cambridge University Press. 10.1017/CBO9781139084727.008
    https://doi.org/10.1017/CBO9781139084727.008 [Google Scholar]
  37. Parrill, F. and Stec, K.
    2018 Seeing First Person Changes Gesture But Saying First Person does Not. Gesture17(1): 158–175. 10.1075/gest.00014.par
    https://doi.org/10.1075/gest.00014.par [Google Scholar]
  38. Parrill, F., Stec, K. and Quinto-Pozos, D.
    2016 Linguistic, Gestural, and Cinematographic Viewpoint: An Analysis of ASL and English Narrative. Cognitive Linguistics27(3): 345–369. 10.1515/cog‑2015‑0081
    https://doi.org/10.1515/cog-2015-0081 [Google Scholar]
  39. Perniss, P.
    2007 Achieving Spatial Coherence in German Sign Language Narratives: The Use of Classifiers and Perspective. Lingua117(7): 1315–1338. 10.1016/j.lingua.2005.06.013
    https://doi.org/10.1016/j.lingua.2005.06.013 [Google Scholar]
  40. Perniss, P. and Özyürek, A.
    2015 Visible Cohesion: A Comparison of Reference Tracking in Sign, Speech, and Co-Speech Gesture. Topics in Cognitive Science Society7: 36–60. 10.1111/tops.12122
    https://doi.org/10.1111/tops.12122 [Google Scholar]
  41. Quer, J.
    2011 Reporting and Quoting in Signed Discourse. InUnderstanding Quotation, E. Brendel, J. Meibauer and M. Steinbach (eds), 277–302. Berlin: Mouton de Gruyter. 10.1515/9783110240085.277
    https://doi.org/10.1515/9783110240085.277 [Google Scholar]
  42. Quinto-Pozos, D.
    2007a Can Constructed Action be Considered Obligatory?Lingua117:1285–1314. 10.1016/j.lingua.2005.12.003
    https://doi.org/10.1016/j.lingua.2005.12.003 [Google Scholar]
  43. 2007b Why does Constructed Action seem Obligatory? An Analysis of Classifiers and the Lack of Articulator-Referent Correspondence. Sign Language Studies7(4): 458–506. 10.1353/sls.2007.0027
    https://doi.org/10.1353/sls.2007.0027 [Google Scholar]
  44. Quinto-Pozos, D. and Mehta, S.
    2010 Register Variation in Mimetic Gestural Complements to Signed Language. Journal of Pragmatics42: 557–584. 10.1016/j.pragma.2009.08.004
    https://doi.org/10.1016/j.pragma.2009.08.004 [Google Scholar]
  45. Quinto-Pozos, D. and Parrill, F.
    2015 Signers and Co-Speech Gesturers Adopt Similar Strategies for Portraying Viewpoint in Narratives. Topics in Cognitive Science7(1): 12–35. 10.1111/tops.12120
    https://doi.org/10.1111/tops.12120 [Google Scholar]
  46. Rekittke, L.-M.
    2017 Viewpoint and Stance in Gesture: How a Potential Taboo Topic may Influence Gestural Viewpoint in Recounting Films. Journal of Pragmatics122, 50–64. 10.1016/j.pragma.2017.08.013
    https://doi.org/10.1016/j.pragma.2017.08.013 [Google Scholar]
  47. Sandler, W. and Lillo-Martin, D.
    2006Sign Language and Linguistic Universals. Cambridge: Cambridge University Press. 10.1017/CBO9781139163910
    https://doi.org/10.1017/CBO9781139163910 [Google Scholar]
  48. Schlenker, P.
    2017 Super Monsters I: Attitude and Action Role Shift in Sign Language. Semantics and Pragmatics10(9): 1–65. 10.3765/sp.10.12
    https://doi.org/10.3765/sp.10.12 [Google Scholar]
  49. Stites, L. J. and Özçalışkan, Ş.
    2017 Who Did what to whom? Children Track Story Referents First in Gesture. Journal of Psycholinguistic Research46(4): 1019–1032. 10.1007/s10936‑017‑9476‑0
    https://doi.org/10.1007/s10936-017-9476-0 [Google Scholar]
  50. Steinbach, M.
    2021 Role Shift: Theoretical Perspectives. InThe Routledge Handbook of Theoretical and Experimental Sign Language Research. J. Quep, R. Pfau and A. Herrmann (eds), 351–377. Abingdon: Routledge. 10.4324/9781315754499‑16
    https://doi.org/10.4324/9781315754499-16 [Google Scholar]
  51. Wilkins, K. and Holler, J.
    2011 Speakers’ Use of ‘Action’ and ‘Entity’ Gestures with Definite and Indefinite References. InIntegrating Gestures, G. Stam and M. Ishino (eds), 293–307. Amsterdam: John Benjamins. 10.1075/gs.4.27wil
    https://doi.org/10.1075/gs.4.27wil [Google Scholar]
  52. Wulf, A., Dudis, P., Bayley, R. and Lucas, C.
    2002 Variable Subject Presence in ASL Narratives. Sign Language Studies3(1): 54–76. 10.1353/sls.2002.0027
    https://doi.org/10.1353/sls.2002.0027 [Google Scholar]
/content/journals/10.1075/lic.00023.qui
Loading
/content/journals/10.1075/lic.00023.qui
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error