Functional and temporal relations between spoken and gestured components of language

MyBook is a cheap paperback edition of the original book and will be sold at uniform, low price.

Buy this article

Price: £15.00+Taxes
Add to favourites

A corpus-based inquiry

The full text of this article is not currently available.

Data & Media loading...


Full text loading...


Adolphs, S. , & Carter, R.
(2013) Spoken corpus linguistics: From monomodal to multimodal. New York, NY: Routledge.
Alahverdzhieva, K.
(2013) Alignment of speech and co-speech gesture in a constraint-based grammar. (Unpublished doctoral dissertation), University of Edinburgh, Edinburgh.
Altman, D. G. , & Bland, J. M.
(2011) How to obtain the P value from a confidence interval. British Medical Journal, 343(2304). Retrieved (last accessedFebruary 2017).
Bergmann, K. , Aksu, V. , & Kopp, S.
(2011) The relation of speech and gestures: Temporal synchrony follows semantic synchrony. Paper presented at the2nd Workshop on Gesture and Speech in Interaction, Bielefeld, Germany.
Bergmann, K. , & Kopp, S.
(2009) GNetIc – Using Bayesian decision networks for iconic gesture generation. In Z. Ruttkay , M. Kipp , A. Nijholt & H. H. Vilhjálmsson (Eds.), Proceedings of the 9th International Conference on Virtual Agents (pp.76–89). Amsterdam: Springer.
Bergmann, K. , Kopp, S. , & Eyssel, F.
(2010) Individualized gesturing outperforms average gesturing – evaluating gesture production in virtual humans. In J. Allbeck , N. Badler , T. Bickmore , C. Pelachaud & A. Safonova (Eds.), Proceedings of the 10th Conference on Intelligent Virtual Agents (pp.104–117). Philadelphia, PA: Springer. doi: 10.1007/978‑3‑642‑15892‑6_11
Cienki, A.
(2012) Usage events of spoken language and the symbolic units we (may) abstract from them. In K. Kosecki & J. Badio (Eds.), Cognitive Processes in Language (pp.149–158). Frankfurt am Main: Peter Lang.
Damerau, F. J.
(1993) Generating and evaluating domain-oriented multi-word terms from texts. Information Processing & Management, 29(4), 433–447. doi: 10.1016/0306‑4573(93)90039‑G
Diemer, S. , Brunner, M. L. , & Schmidt, S.
(2016) Compiling computer-mediated spoken language corpora. International Journal of Corpus Linguistics, 21(3), 348–371. doi: 10.1075/ijcl.21.3.03die
Enfield, N. J.
(2004) On linear segmentation and combinatorics in co-speech gesture: A symmetry-dominance construction in Lao fish trap descriptions. Semiotica, 149(1–4), 57–124.
Fricke, E.
(2007) Origo, Geste und Raum: Lokaldeixis im Deutschen. Berlin: Walter de Gruyter. doi: 10.1515/9783110897746
(2009) Multimodal attribution: How gestures are syntactically integrated into spoken language. Paper presented at thefirst Gesture and Speech in Interaction conference (GeSpIn), Poznań, Poland.
(2012) Grammatik multimodal: Wie Wörter und Gesten zusammenwirken. Berlin: Walter de Gruyter. doi: 10.1515/9783110218893
Hadar, U. , & Krauss, R. K.
(1999) Iconic gestures: The grammatical categories of lexical affiliates. Journal of Neurolinguistics, 12(1), 1–12. doi: 10.1016/S0911‑6044(99)00001‑9
Harrison, S.
(2008) The expression of negation through grammar and gesture. In J. Zlatev , M. Andrén , M. J. Falck & C. Lundmark (Eds.), Studies in Language and Cognition (pp.405–419). Cambridge: Cambridge Scholars Press.
(2009) Grammar, gesture, and cognition: The case of negation in English (Unpublished doctoral dissertation). University of Bordeaux, Bordeaux, France.
Hinrichs, E. , Hinrichs, M. , & Zastrow, T.
(2010) WebLicht: Web-based LRT services for German. In S. Kübler (Ed.), Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics 2010 System Demonstrations (pp.25–29). Uppsala, Sweden.
Hole, D. , & Klumpp, G.
(2000) Definite type and indefinite token: The article son in colloquial German. Linguistische Berichte, 182(1), 231–244.
Kendon, A.
(1995) Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23(3), 247–279. doi: 10.1016/0378‑2166(94)00037‑F
(2004) Gesture: Visible Action as Utterance. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511807572
Knight, D.
(2011) Multimodality and Active Listenership: A Corpus Approach. London: Continuum Books.
Knight, D. , Evans, D. , Carter, R. , & Adolphs, S.
(2009) HeadTalk, HandTalk and the corpus: Towards a framework for multi-modal, multi-media corpus development. Corpora, 4(1), 1–32. doi: 10.3366/E1749503209000203
Kisler, T. , Schiel, F. , & Sloetjes, H.
(2012) Signal processing via web services: The use case WebMAUS. In E. Hinrichs , H. Neuroth & P. Wittenburg (Eds.), Proceedings of the Service-oriented Architectures (SOAs) workshop at the Digital Humanities Conference 2012 (pp.30–34). Hamburg, Germany.
Kok, K. I.
(2016) The grammatical potential of co-speech gesture: A Functional Discourse Grammar perspective. Functions of Language, 23(2), 149–178. doi: 10.1075/fol.23.2.01kok
Kok, K. I. , Bergmann, K. , Cienki, A. , & Kopp, S.
(2016) Mapping out the multifunctionality of speakers’ gestures. Gesture, 15(1), 37–59. doi: 10.1075/gest.15.1.02kok
Kok, K. I. , & Cienki, A.
(2016) Cognitive Grammar and gesture: Points of convergence, advances and challenges. Cognitive Linguistics, 27(1), 67–100. doi: 10.1515/cog‑2015‑0087
Kopp, S. , Bergmann, K. , & Wachsmuth, I.
(2008) Multimodal communication from multimodal thinking – towards an integrated model of speech and gesture production. International Journal of Semantic Computing, 2(1), 115–136. doi: 10.1142/S1793351X08000361
Krauss, R. M. , Chen, Y. , & Gottesman, R. F.
(2000) Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and Gesture (pp.261–283). Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511620850.017
Ladewig, S. H.
(2012) Syntactic and semantic integration of gestures into speech: Structural, cognitive, and conceptual aspects (Unpublished doctoral dissertation). European University Viadrina, Frankfurt (Oder).
Langacker, R. W.
(1987) Foundations of Cognitive Grammar, Volume I: Theoretical Prerequisites. Stanford: Stanford University Press.
Leonard, T. , & Cummins, F.
(2011) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. doi: 10.1080/01690965.2010.500218
Levy, E. T. , & McNeill, D.
(1992) Speech, gesture, and discourse. Discourse Processes, 15(3), 277–301. doi: 10.1080/01638539209544813
Loehr, D. P.
(2004) Gesture and intonation (Unpublished doctoral dissertation). Georgetown University, Washington D.C.
Lücking, A. , Bergmann, K. , Hahn, F. , Kopp, S. , & Rieser, H.
(2010) The Bielefeld speech and gesture alignment corpus (SaGA). In M. Kipp , J. C. Martin , P. Paggio & D. Heylen (Eds.), Proceedings of the 7th International Conference for Language Resources and Evaluation (pp.92–98). Valetta, Malta.
(2013) Data-based analysis of speech and gesture: The Bielefeld Speech and Gesture Alignment Corpus (SaGA) and its applications. Journal on Multimodal User Interfaces, 7(1–2), 5–18. doi: 10.1007/s12193‑012‑0106‑8
McCarthy, M. , & Carter, R.
(1996) Ten criteria for a spoken grammar. In E. Hinkel & S. Fotos (Eds.), New Perspectives in Grammar Teaching in Second Language Classrooms (pp.51–75). Mahwah, NJ: Lawrence Erlbaum.
McNeill, D.
(1992) Hand and Mind: What Gestures Reveal about Thought. Chicago, IL: University of Chicago Press.
(2000) Catchments and contexts: Non-modular factors in speech and gesture production. In D. McNeill (Ed.), Language and Gesture (pp.312–328). Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511620850.019
Morrel-Samuels, P. , & Krauss, R. M.
(1992) Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, and Cognition, 18(3), 615–622.
Müller, C. , Ladewig, S. H. , & Bressem, J.
(2013) Gestures and speech from a linguistic perspective: A new field and its history. In C. Müller , A. Cienki , E. Fricke , S. Ladewig , D. McNeill & J. Bressem (Eds.), Body-Language-Communication: An International Handbook on Multimodality in Human Interaction (Vol.1, pp.55–81). Berlin/Boston: De Gruyter Mouton.
Schiller, A. , Teufel, S. , & Thielen, C.
(1995) Guidelines für das Tagging deutscher Textcorpora mit STTS. Unpublished report. University of Stuttgart.
Schoonjans, S.
(2014a) Is gesture subject to grammaticalization?Papers of the Linguistic Society of Belgium, 8. Retrieved (last accessedMay 2016).
(2014b) Modalpartikeln als multimodale Konstruktionen. Eine korpusbasierte Kookkurrenzanalyse von Modalpartikeln und Gestik im Deutschen (Unpublished doctoral dissertation). University of Leuven, Leuven, Belgium.
Streeck, J.
(1993) Gesture as communication: Its coordination with gaze and speech. Communications Monographs, 60(4), 275–299. doi: 10.1080/03637759309376314
(2002) Grammars, words, and embodied meanings: On the uses and evolution of so and like. Journal of Communication, 52(3), 581–596. doi: 10.1111/j.1460‑2466.2002.tb02563.x
Thurmair, M.
(1989) Modalpartikeln und ihre Kombinationen. Tübingen: Niemeyer. doi: 10.1515/9783111354569
Turner, M. , & Steen, F.
(2012) Multimodal Construction Grammar. In M. Borkent , B. Dancygier & J. A. J. Hinnell (Eds.), Language and the Creative Mind (pp.255–274). Stanford, CA: CSLI Publications.
van Son, R. , Wesseling, W. , Sanders, E. , & van den Heuvel, H.
(2008) The IFADV corpus: A free dialog video corpus. Proceedings of the sixth international conference on Language Resources and Evaluation (LREC) (pp.501–508). Marrakech: European Language Resources Association (ELRA).
Zima, E.
(2014) English multimodal motion constructions. A construction grammar perspective. Papers of the Linguistic Society of Belgium, 8. Retrieved (last accessedMay 2016).
This is a required field
Please enter a valid email address