1887
image of Embodying stories

Abstract

This study examines the multimodal characteristics of child-directed (CDS) and adult-directed (ADS) speech, focusing on speech and gesture behavior, with particular emphasis on gesture referentiality, viewpoint, and informativeness. Forty Early Childhood Education students ( = 20.45, 35 female) narrated the same wordless cartoon to simulated adult and child audiences (TEACH-TALK corpus), producing 196.33 minutes of speech and 7,191 gestures. Results showed that the CDS narratives were longer and included more referential iconic gestures. No differences in the overall gesture rate or gesture informativeness were found between conditions. Notably, iconic gestures with character viewpoint exhibited a higher frequency in CDS, indicating that these gestures, in conjunction with speech, may facilitate children’s comprehension by enhancing clarity and expressiveness of the narrative content.

Available under the CC BY 4.0 license.
Loading

Article metrics loading...

/content/journals/10.1075/itl.25006.li
2026-06-10
2026-07-13
Loading full text...

Full text loading...

/deliver/fulltext/10.1075/itl.25006.li/itl.25006.li.html?itemId=/content/journals/10.1075/itl.25006.li&mimeType=html&fmt=ahah

References

  1. Alibali, M. W., Evans, J. L., Hostetter, A. B., Ryan, K., & Mainela-Arnold, E.
    (2009) Gesture–speech integration in narrative: Are children less redundant than adults?Gesture, (), –. 10.1075/gest.9.3.02ali
    https://doi.org/10.1075/gest.9.3.02ali [Google Scholar]
  2. Avineri, N.
    (2020) Audience (and audience design). InThe international encyclopedia of linguistic anthropology (pp.–). Wiley. 10.1002/9781118786093.iela0019
    https://doi.org/10.1002/9781118786093.iela0019 [Google Scholar]
  3. Bates, D., Mächler, M., Bolker, B., Walker, S., Christensen, R. H. B., Singmann, H., … Bolker, M. B.
    (2015) lme4 (Version 1.1-27) [Computer software]. https://cran.r-project.org/package=lme4
    [Google Scholar]
  4. Beattie, G., & Shovelton, H.
    (2002) An experimental investigation of some properties of individual iconic gestures that mediate their communicative power. British Journal of Psychology, (), –. 10.1348/000712602162526
    https://doi.org/10.1348/000712602162526 [Google Scholar]
  5. Bell, A.
    (1984) Language style as audience design. Language in Society, (), –. 10.1017/S004740450001037X
    https://doi.org/10.1017/S004740450001037X [Google Scholar]
  6. Boersma, P., & Weenink, D.
    (2023) Praat: Doing phonetics by computer (Version 6.3.06) [Computer software]. www.praat.org
    [Google Scholar]
  7. Brennan, S. E., Galati, A., & Kuhlen, A. K.
    (2010) Two minds, one dialog: Coordinating speaking and understanding. Psychology of Learning and Motivation, , –.
    [Google Scholar]
  8. Campisi, E., & Özyürek, A.
    (2013) Iconicity as a communicative strategy: Recipient design in multimodal demonstrations for adults and children. Journal of Pragmatics, (), –. 10.1016/j.pragma.2012.12.007
    https://doi.org/10.1016/j.pragma.2012.12.007 [Google Scholar]
  9. Clark, H. H., & Wilkes-Gibbs, D.
    (1986) Referring as a collaborative process. Cognition, (), –. 10.1016/0010‑0277(86)90010‑7
    https://doi.org/10.1016/0010-0277(86)90010-7 [Google Scholar]
  10. Cristia, A.
    (2013) Input to language: The phonetics and perception of infant-directed speech. Language and Linguistics Compass, (), –. 10.1111/lnc3.12015
    https://doi.org/10.1111/lnc3.12015 [Google Scholar]
  11. Demir, Ö. E., Levine, S. C., & Goldin-Meadow, S.
    (2015) A tale of two hands: Children’s early gesture use in narrative production predicts later narrative structure in speech. Journal of Child Language, (), –. 10.1017/S0305000914000415
    https://doi.org/10.1017/S0305000914000415 [Google Scholar]
  12. Drijvers, L., & Özyürek, A.
    (2017) Visual context enhanced: The joint contribution of iconic gestures and visible speech to degraded speech comprehension. Journal of Speech, Language, and Hearing Research, (), –. 10.1044/2016_JSLHR‑H‑16‑0101
    https://doi.org/10.1044/2016_JSLHR-H-16-0101 [Google Scholar]
  13. ELAN (Version 6.8) [Computer software]
    ELAN (Version 6.8) [Computer software] (2024) Max Planck Institute for Psycholinguistics, The Language Archive. https://archive.mpi.nl/tla/elan
  14. Gernsbacher, M. A., Goldsmith, H. H., & Robertson, R. R.
    (1992) Do readers mentally represent characters’ emotional states?Cognition & Emotion, (), –. 10.1080/02699939208411061
    https://doi.org/10.1080/02699939208411061 [Google Scholar]
  15. Goldin-Meadow, S.
    (2003) Hearing gesture: How our hands help us think. Harvard University Press.
    [Google Scholar]
  16. Gwet, K. L.
    (2014) Handbook of inter-rater reliability (4th ed.). Advanced Analytics.
    [Google Scholar]
  17. Hanamoto, H.
    (2023) Representing temporal concepts using redundant gestures in L2 ongoing interactions. Linguistics Beyond and Within, , –. 10.31743/lingbaw.17014
    https://doi.org/10.31743/lingbaw.17014 [Google Scholar]
  18. Han, M., De Jong, N. H., & Kager, R.
    (2022) Prosodic input and children’s word learning in infant- and adult-directed speech. Infant Behavior and Development, , Article 101728. 10.1016/j.infbeh.2022.101728
    https://doi.org/10.1016/j.infbeh.2022.101728 [Google Scholar]
  19. Hindman, A. H., Farrow, J. M., Anderson, K., Wasik, B. A., & Snyder, P. A.
    (2021) Understanding child-directed speech around book reading in toddler classrooms. Frontiers in Psychology, , Article 719783. 10.3389/fpsyg.2021.719783
    https://doi.org/10.3389/fpsyg.2021.719783 [Google Scholar]
  20. Hostetter, A. B., & Alibali, M. W.
    (2008) Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, (), –.
    [Google Scholar]
  21. Johnson-Laird, P. N.
    (1983) Mental models: Towards a cognitive science of language, inference, and consciousness. Harvard University Press.
    [Google Scholar]
  22. Kandemir, S., Özer, D., & Aktan-Erciyes, A.
    (2024) Multimodal language in child-directed versus adult-directed speech. Quarterly Journal of Experimental Psychology, (), –. 10.1177/17470218231188832
    https://doi.org/10.1177/17470218231188832 [Google Scholar]
  23. Kendon, A.
    (1980) Gesticulation and speech: Two aspects of the process of utterance. InM. R. Key (Ed.), The relationship of verbal and nonverbal communication (pp.–). Mouton. 10.1515/9783110813098.207
    https://doi.org/10.1515/9783110813098.207 [Google Scholar]
  24. Kintsch, W.
    (1998) The representation of knowledge in minds and machines. International Journal of Psychology, (), –.
    [Google Scholar]
  25. Kita, S., & Özyürek, A.
    (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal?Journal of Memory and Language, (), –. 10.1016/S0749‑596X(02)00505‑3
    https://doi.org/10.1016/S0749-596X(02)00505-3 [Google Scholar]
  26. McNeill, D.
    (1992) Hand and mind: What gestures reveal about thought. University of Chicago Press.
    [Google Scholar]
  27. Parrill, F.
    (2010) Viewpoint in speech–gesture integration. Language and Cognitive Processes, (), –. 10.1080/01690960903424248
    https://doi.org/10.1080/01690960903424248 [Google Scholar]
  28. (2011) Encoding motion event information and viewpoint in gesture. Gesture, (), –. 10.1075/gest.11.1.04par
    https://doi.org/10.1075/gest.11.1.04par [Google Scholar]
  29. Parrill, F., Lavanty, B., Bennett, A., Klco, A., & Demir-Lira, O. E.
    (2018) Character viewpoint gesture and narrative structure in children. Language and Cognition, (), –. 10.1017/langcog.2018.9
    https://doi.org/10.1017/langcog.2018.9 [Google Scholar]
  30. Phillips, J. R.
    (1973) Syntax and vocabulary of mothers’ speech to young children. Child Development, (), –. 10.2307/1127699
    https://doi.org/10.2307/1127699 [Google Scholar]
  31. Snow, C. E.
    (1972) Mothers’ speech to children learning language. Child Development, , –. 10.2307/1127555
    https://doi.org/10.2307/1127555 [Google Scholar]
  32. Stec, K.
    (2012) Meaningful shifts: A review of viewpoint markers in co-speech gesture. Gesture, (), –. 10.1075/gest.12.3.03ste
    https://doi.org/10.1075/gest.12.3.03ste [Google Scholar]
  33. Tellier, M.
    (2008) The effect of gestures on second language memorisation by young children. Gesture, (), –. 10.1075/gest.8.2.06tel
    https://doi.org/10.1075/gest.8.2.06tel [Google Scholar]
  34. Vilà-Giménez, I., Coego, S., Fraser, A., Geladó, S., Li, J., & Prieto, P.
    (2025, March17). TEACH-TALK: An audiovisual corpus of future teachers’ child- and adult-directed narratives. 10.17605/OSF.IO/AE3XR
    https://doi.org/10.17605/OSF.IO/AE3XR [Google Scholar]
  35. Zhang, Y., & Gu, Y.
    (2024) Individual differences in multimodal child-directed language. InProceedings of the 46th Annual Meeting of the Cognitive Science Society.
    [Google Scholar]
/content/journals/10.1075/itl.25006.li
Loading
/content/journals/10.1075/itl.25006.li
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error