oa Towards a novel conceptualization of prosody that accounts for spoken and visual signals

References

1. Ambrazaitis, G. & House, D.
   (2022) Probing effects of lexical prosody on speech-gesture integration in prominence production by Swedish news presenters. Laboratory Phonology24(1), 1–35. 10.16995/labphon.6430
   https://doi.org/10.16995/labphon.6430 [Google Scholar]
2. Ambrazaitis, G. & House, D.
   (2023) The multimodal nature of prominence: some directions for the study of the relation between gestures and pitch accents. Proceedings of the 13th International Conference of Nordic Prosody, pp.262–273. 10.2478/9788366675728‑024
   https://doi.org/10.2478/9788366675728-024 [Google Scholar]
3. Armstrong, M., Esteve Gibert, N., Hübscher, I., Igualada, A., & Prieto, P.
   (2018) Developmental and cognitive aspects of children’s disbelief comprehension through intonation and facial gesture. First Language, 38(6), 596–616. 10.1177/0142723718789278
   https://doi.org/10.1177/0142723718789278 [Google Scholar]
4. Bahrick, L. E., & Lickliter, R.
   (2012) The role of intersensory redundancy in early perceptual, cognitive, and social development. InA. J. Bremner, D. J. Lewkowicz, & C. Spence (Eds.), Multisensory development, pp.183–206. Oxford University Press. 10.1093/acprof:oso/9780199586059.003.0008
   https://doi.org/10.1093/acprof:oso/9780199586059.003.0008 [Google Scholar]
5. Barnes, J., & Shattuck-Hufnagel, S.
   (eds.) (2022) Prosodic theory and practice. MIT Press. 10.7551/mitpress/10413.001.0001
   https://doi.org/10.7551/mitpress/10413.001.0001 [Google Scholar]
6. Bauer A., Kuder A., Schulder M., Schepens J.
   (2024) Phonetic differences between affirmative and feedback head nods in German Sign Language (DGS): A pose estimation study. PLoS ONE19(5): e0304040.
   [Google Scholar]
7. Ter Bekke, M., Drijvers, L., & Holler, J.
   (2024) Hand gestures have predictive potential during conversation: An investigation of the timing of gestures in relation to speech. Cognitive science, 48(1), e13407. 10.1111/cogs.13407
   https://doi.org/10.1111/cogs.13407 [Google Scholar]
8. Berger, S., & Zellers, M.
   (2022) Multimodal prominence marking in semi-spontaneous YouTube monologues: The interaction of intonation and eyebrow movements, Frontiers in Communication, 71, 132. 10.3389/fcomm.2022.903015
   https://doi.org/10.3389/fcomm.2022.903015 [Google Scholar]
9. Biau, E., & Soto-Faraco, S.
   (2013) Beat gestures modulate auditory integration in speech perception. Brain and language, 124(2), 143–152. 10.1016/j.bandl.2012.10.008
   https://doi.org/10.1016/j.bandl.2012.10.008 [Google Scholar]
10. Bögels, S., & Torreira, F.
    (2015) Listeners use intonational phrase boundaries to project turn ends in spoken interaction, Journal of Phonetics, 521, 46–57. 10.1016/j.wocn.2015.04.004
    https://doi.org/10.1016/j.wocn.2015.04.004 [Google Scholar]
11. Borràs-Comes, J., Kiagia, E., & Prieto, P.
    (2019) Epistemic intonation and epistemic gesture are mutually co-expressive: Empirical results from two intonation-gesture matching tasks. Journal of Pragmatics, 1501, 39–52. 10.1016/j.pragma.2019.07.004
    https://doi.org/10.1016/j.pragma.2019.07.004 [Google Scholar]
12. Borràs-Comes, J., & Prieto, P.
    (2011) ‘Seeing tunes.’ The role of visual gestures in tune interpretation. Laboratory Phonology2(2), 355–80. 10.1515/labphon.2011.013
    https://doi.org/10.1515/labphon.2011.013 [Google Scholar]
13. Bosker, H. R., & Peeters, D.
    (2021) Beat gestures influence which speech sounds you hear. Proceedings of the Royal Society B, 288(1943), 20202419. 10.1098/rspb.2020.2419
    https://doi.org/10.1098/rspb.2020.2419 [Google Scholar]
14. Brentari, D.
    (1998) A prosodic model of sign language phonology. MIT Press.
    [Google Scholar]
15. Brown, L., & Prieto, P.
    (2021) Gesture and prosody in multimodal communication. InM. Haugh, D. Z. Kádár & M. Terkourafi (Eds.), The Cambridge handbook of sociopragmatics, pp.430–453. Cambridge University Press. 10.1017/9781108954105.023
    https://doi.org/10.1017/9781108954105.023 [Google Scholar]
16. Bujok, R., Meyer, A. S., & Bosker, H. R.
    (2025) Audiovisual perception of lexical stress: Beat gestures and articulatory cues. Language and Speech, 68(1), 181–203. 10.1177/00238309241258162
    https://doi.org/10.1177/00238309241258162 [Google Scholar]
17. Byrd, D., & Krivokapić, J.
    (2021) Cracking prosody in articulatory phonology. Annual Review of Linguistics, 71, 31–53. 10.1146/annurev‑linguistics‑030920‑050033
    https://doi.org/10.1146/annurev-linguistics-030920-050033 [Google Scholar]
18. Chen, A., Esteve-Gibert, N., Prieto, P. & Redford, M.
    (2020) Development of phrase-level prosody from infancy to late childhood. InC. Gussenhoven & A. Chen (Eds.), The Oxford handbook of language prosody, pp.552–562. Oxford University Press.
    [Google Scholar]
19. Cienki, A.
    (2022) The study of gesture in cognitive linguistics: How it could inform and inspire other research in cognitive science. Wiley interdisciplinary reviews. Cognitive science, 13(6), e1623. 10.1002/wcs.1623
    https://doi.org/10.1002/wcs.1623 [Google Scholar]
20. Crespo-Sendra, V., Kaland, C., Swerts, M., & Prieto, P.
    (2013) Perceiving incredulity: The role of intonation and facial gestures. Journal of Pragmatics, 471, 1–13. 10.1016/j.pragma.2012.08.008
    https://doi.org/10.1016/j.pragma.2012.08.008 [Google Scholar]
21. Cruz, M., Swerts, M. & Frota, S.
    (2017) The role of intonation and visual cues in the perception of sentence types: Evidence from European Portuguese varieties, Laboratory Phonology8(1): 23. 10.5334/labphon.110
    https://doi.org/10.5334/labphon.110 [Google Scholar]
22. Cruz, M., & Frota, S.
    (2024) Four seasons in one head: The prosodic phrasing of enumerations in Portuguese Sign Language [Paper presentation]. The 2nd International Multimodal Communication Symposium (MMSYM 2024), September 25–27, Frankfurt, Germany.
    [Google Scholar]
23. Cruz, M., & Frota, S.
    (2025) “Talking heads” in Portuguese sign and spoken Languages. Language and Cognition. 171:e18. 10.1017/langcog.2024.63
    https://doi.org/10.1017/langcog.2024.63 [Google Scholar]
24. Dachkovsky, S., & Sandler, W.
    (2009) Visual intonation in the prosody of a sign language. Language and Speech, 52(2–3), 287–314. 10.1177/0023830909103175
    https://doi.org/10.1177/0023830909103175 [Google Scholar]
25. Debreslioska, S., & Gullberg, M.
    (2022) Information status predicts the incidence of gesture in discourse: An experimental study. Discourse Processes, 59(10), 791–827. 10.1080/0163853X.2022.2085476
    https://doi.org/10.1080/0163853X.2022.2085476 [Google Scholar]
26. Dohen, M., Loevenbruck, H., Cathiard, M.-A., & Schwartz, J.-L.
    (2004) Visual perception of contrastive focus in reiterant French speech. Speech Communication, 44(1–4), 155–172. 10.1016/j.specom.2004.10.009
    https://doi.org/10.1016/j.specom.2004.10.009 [Google Scholar]
27. Dohen, M., & Loevenbruck, H.
    (2009) Interaction of audition and vision for the perception of prosodic contrastive focus. Language and Speech, 52(2–3), 177–206. 10.1177/0023830909103166
    https://doi.org/10.1177/0023830909103166 [Google Scholar]
28. De la Cruz-Pavía, I.
    (2022) The role of audio-visual phrasal prosody in bootstrapping the acquisition of word order. Proceedings of Speech Prosody20221, 230–234. 10.21437/SpeechProsody.2022‑47
    https://doi.org/10.21437/SpeechProsody.2022-47 [Google Scholar]
29. Ebert, C., Evert, S., & Wilmes, K.
    (2011) Focus marking via gestures. Proceedings of Sinn Und Bedeutung, 151, 193–208.
    [Google Scholar]
30. Esteve-Gibert, N., Loevenbruck, H., Dohen, M., & D’Imperio, M.
    (2021) Pre-schoolers use head gestures rather than prosodic cues to highlight important information in speech. Developmental Science, 251, e13154. 10.1111/desc.13154
    https://doi.org/10.1111/desc.13154 [Google Scholar]
31. Esteve-Gibert, N., & Prieto, P.
    (2013) Prosodic structure shapes the temporal realization of intonation and manual gesture movements. Journal of Speech, Language, and Hearing Research, 56(3), 850–864. 10.1044/1092‑4388(2012/12‑0049)
    https://doi.org/10.1044/1092-4388(2012/12-0049) [Google Scholar]
32. Esteve-Gibert, N., P. Prieto & F. Pons
    (2015) Nine-month-old infants are sensitive to the temporal alignment of prosodic and gesture prominences. Infant Behavior and Development, 381, 126–129. 10.1016/j.infbeh.2014.12.016
    https://doi.org/10.1016/j.infbeh.2014.12.016 [Google Scholar]
33. Esteve-Gibert, N., Borràs-Comes, J., Asor, E., Swerts, M., & Prieto, P.
    (2017) The timing of head movements: The role of prosodic heads and edges. The Journal of the Acoustical Society of America, 141(6), 4727–4739. 10.1121/1.4986649
    https://doi.org/10.1121/1.4986649 [Google Scholar]
34. Esteve-Gibert, N., Prieto, P. & Shattuck-Hufnagel, S.
    (2025) How a modality-neutral prosodic dimension can enrich the Multimodal Language Acquisition Framework: A commentary on Karadöller, Sümer and Özyürek. First Language. 10.1177/01427237251335804
    https://doi.org/10.1177/01427237251335804 [Google Scholar]
35. Fernald, A., & Simon, T.
    (1984) Expanded intonation contours in mothers’ speech to newborns. Developmental Psychology, 201, 104–113. 10.1037/0012‑1649.20.1.104
    https://doi.org/10.1037/0012-1649.20.1.104 [Google Scholar]
36. Ferré, G.
    (2010) Timing relationships between speech and co-verbal gestures in spontaneous French. International Conference on Language Resources and Evaluation (LREC), 86–91.
    [Google Scholar]
37. Franich, K., Keupdjio, H. & Nwosu, V.
    (2025) The timing of speech and gesture in two Niger-Congo languages: Implications for word-level prominence. Glossa: A Journal of General Linguistics10(1).
    [Google Scholar]
38. Florit-Pons, J., Vilà-Giménez, I., Rohrer, P. L., & Prieto, P.
    (2023) Multimodal development in children’s narrative speech: Evidence for tight gesture-speech temporal alignment patterns as early as 5 years old. Journal of Speech, Language, and Hearing Research, 66(3), 888–900. 10.1044/2022_JSLHR‑22‑00451
    https://doi.org/10.1044/2022_JSLHR-22-00451 [Google Scholar]
39. Floyd, S., Manrique, E., Rossi, G., & Torreira, F.
    (2015) Timing of visual bodily behavior in repair sequences: Evidence from three languages. Discourse Processes, 53(3), 175–204. 10.1080/0163853X.2014.992680
    https://doi.org/10.1080/0163853X.2014.992680 [Google Scholar]
40. Fung, H. S. H. & Mok, P. P. K.
    (2018) Temporal coordination between focus prosody and pointing gestures in Cantonese. Journal of Phonetics, 711, 113–125. 10.1016/j.wocn.2018.07.006
    https://doi.org/10.1016/j.wocn.2018.07.006 [Google Scholar]
41. de Gelder, B., & Vroomen, J.
    (2000) The perception of emotion by ear and by eye. Cognition and Emotion, 14(3), 289–311. 10.1080/026999300378824
    https://doi.org/10.1080/026999300378824 [Google Scholar]
42. Gentilucci, M. & Corballis, M. C.
    (2006) From manual gesture to speech: A gradual transition. Neurosci Biobehav Rev. 30(7):949–60. 10.1016/j.neubiorev.2006.02.004
    https://doi.org/10.1016/j.neubiorev.2006.02.004 [Google Scholar]
43. Gervain, J., Christophe, A., Mazuka, R.
    (2020) Prosodic bootstrapping. InGussenhoven, C., Chen, A. (Eds.), The Oxford handbook of language prosody, pp.563–573. Oxford University Press.
    [Google Scholar]
44. Giberga, A., Igualada, A., Ahufinger, N., Aguilera, M., Guerra, E., Esteve-Gibert, N.
    (2025a) Prosody and Gestures Help Pragmatic Processing in Children with Developmental Language Disorder. Language and Communication Disorders1151, 106525. 10.1016/j.jcomdis.2025.106525
    https://doi.org/10.1016/j.jcomdis.2025.106525 [Google Scholar]
45. Giberga, A., Igualada, A., Ahufinger, N., Aguilera, M., Guerra, E., Esteve-Gibert, N.
    (2025b) How children with and without developmental language disorder use prosody and gestures to process phrasal ambiguities, Languages10(4):61. 10.3390/languages10040061
    https://doi.org/10.3390/languages10040061 [Google Scholar]
46. Golinkoff, R. M., Can, D. D., Soderstrom, M., & Hirsh-Pasek, K.
    (2015) (Baby) Talk to me: The social context of infant-directed speech and its effects on early language acquisition. Current Directions in Psychological Science, 24(5), 339–344. 10.1177/0963721415595345
    https://doi.org/10.1177/0963721415595345 [Google Scholar]
47. González-Fuente, S.
    (2021) Audiovisual prosody and verbal irony. [Doctoral dissertation, Universitat Pompeu Fabra, Barcelona.] Available at: hdl.handle.net/10803/670309 (last access27 May 2025).
48. Graziano, M., & Gullberg, M.
    (2018) When speech stops, gesture stops: Evidence from developmental and crosslinguistic comparisons. Frontiers in Psychology, 91, 879. 10.3389/fpsyg.2018.00879
    https://doi.org/10.3389/fpsyg.2018.00879 [Google Scholar]
49. Gregori, A., Sánchez-Ramón, P. G., Prieto, P., Kügler, F.
    (2024) Prosodic and gestural marking of focus types in Catalan and German. InProceedings of the 12th International Conference on Speech Prosody20241, 891–895. 10.21437/SpeechProsody.2024‑180
    https://doi.org/10.21437/SpeechProsody.2024-180 [Google Scholar]
50. Guellaï, B., Langus, A., & Nespor, M.
    (2014) Prosody in the hands of the speaker. Frontiers in Psychology, 51, 1–8. 10.3389/fpsyg.2014.00700
    https://doi.org/10.3389/fpsyg.2014.00700 [Google Scholar]
51. Gussenhoven, C. & Chen, A.
    (2020) The Oxford handbook of language prosody. (Oxford Handbooks in Linguistics.) Oxford University Press. 10.1093/oxfordhb/9780198832232.001.0001
    https://doi.org/10.1093/oxfordhb/9780198832232.001.0001 [Google Scholar]
52. Halliday, M. A. K.
    (1967) Intonation and grammar in British English. De Guyter Mouton. 10.1515/9783111357447
    https://doi.org/10.1515/9783111357447 [Google Scholar]
53. Hagoort, P., & Özyürek, A.
    (2024) Extending the architecture of language from a multimodal perspective. Topics in Cognitive Science. 10.1111/tops.12728
    https://doi.org/10.1111/tops.12728 [Google Scholar]
54. Harrison, S.
    (2010) Evidence for node and scope of negation in coverbal gesture. Gesture10(1), 29–51. 10.1075/gest.10.1.03har
    https://doi.org/10.1075/gest.10.1.03har [Google Scholar]
55. Hirschberg, J.
    (2017) Pragmatics and prosody. InY. Huang (Ed.), The Oxford Handbook of Pragmatics, 532–549. Oxford University Press. 10.1093/oxfordhb/9780199697960.013.28
    https://doi.org/10.1093/oxfordhb/9780199697960.013.28 [Google Scholar]
56. Holler, J., Kendrick, K. H. & Levinson, S. C.
    (2018) Processing language in face-to-face conversation: Questions with gestures get faster responses. Psychon Bull Rev251, 1900–1908. 10.3758/s13423‑017‑1363‑z
    https://doi.org/10.3758/s13423-017-1363-z [Google Scholar]
57. Holler, J., & Levinson, S. C.
    (2019) Multimodal language processing in human communication. Trends in Cognitive Sciences, 23(8), 639–652. 10.1016/j.tics.2019.05.006
    https://doi.org/10.1016/j.tics.2019.05.006 [Google Scholar]
58. Hübscher, I., Esteve-Gibert, N., Igualada, A., & Prieto, P.
    (2017) Intonation and gesture as bootstrapping devices in speaker uncertainty. First Language, 37(1), 24–41. 10.1177/0142723716673953
    https://doi.org/10.1177/0142723716673953 [Google Scholar]
59. Igualada, A., Esteve-Gibert, N., & Prieto, P.
    (2017) Beat gestures improve word recall in 3- to 5-year-old children. Journal of Experimental Child Psychology, 1561, 99–112. 10.1016/j.jecp.2016.11.017
    https://doi.org/10.1016/j.jecp.2016.11.017 [Google Scholar]
60. Iverson, J. M., & Fagan, M. K.
    (2004) Infant vocal-motor coordination: precursor to the gesture-speech system?Child Development, 75(4), 1053–1066. 10.1111/j.1467‑8624.2004.00725.x
    https://doi.org/10.1111/j.1467-8624.2004.00725.x [Google Scholar]
61. Jun, S.-A.
    (Ed.) (2014) Prosodic typology II: The phonology of intonation and phrasing. Oxford University Press. 10.1093/acprof:oso/9780199567300.001.0001
    https://doi.org/10.1093/acprof:oso/9780199567300.001.0001 [Google Scholar]
62. Kallay, J. E., Dilley, L., & Redford, M. A.
    (2022) Prosodic development during the early school-age years. Journal of Speech, Language, and Hearing Research, 65(11), 4025–4046. 10.1044/2022_JSLHR‑22‑00124
    https://doi.org/10.1044/2022_JSLHR-22-00124 [Google Scholar]
63. Karadöller, D., Sümer, B., Özyürek, A.
    (2025) First language acquisition in a multimodal language framework: Insights from speech, gesture, and sign. First Language. 10.1177/01427237241290678
    https://doi.org/10.1177/01427237241290678 [Google Scholar]
64. Keating, P. A., & Shattuck-Hufnagel, S.
    (2002) A prosodic view of word form encoding for speech production. UCLA Working Papers in Phonetics, 1011, 112–15.
    [Google Scholar]
65. Kendon, A.
    (1980) Gesticulation and speech: Two aspects of the process of utterance. InM. R. Key, The relationship of verbal and nonverbal communication, pp.207–228. De Gruyter Mouton. 10.1515/9783110813098.207
    https://doi.org/10.1515/9783110813098.207 [Google Scholar]
66. Kendon, A.
    (2004) Gesture: Visible action as utterance. Cambridge University Press. 10.1017/CBO9780511807572
    https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
67. Kendon, A.
    (2017) Reflections on the “gesture-first” hypothesis of language origins. Psychonomic Bulletin & Review, 24 (1), 163–170. 10.3758/s13423‑016‑1117‑3
    https://doi.org/10.3758/s13423-016-1117-3 [Google Scholar]
68. Kendrick, K. H., Holler, J., & Levinson, S. C.
    (2023) Turn-taking in human face-to-face interaction is multimodal: gaze direction and manual gestures aid the coordination of turn transitions. Philosophical transactions of the Royal Society of London. Series B, Biological sciences, 378 (1875), 20210473. 10.1098/rstb.2021.0473
    https://doi.org/10.1098/rstb.2021.0473 [Google Scholar]
69. Kita, S., Alibali, M. W., & Chu, M.
    (2017) How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological Review, 124(3), 245–266. 10.1037/rev0000059
    https://doi.org/10.1037/rev0000059 [Google Scholar]
70. Kita, S., & Ozyurek, A.
    (2003) What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 481, 16–32. 10.1016/S0749‑596X(02)00505‑3
    https://doi.org/10.1016/S0749-596X(02)00505-3 [Google Scholar]
71. Kitamura, C., Guellaï, B., & Kim, J.
    (2014) Motherese by eye and ear: Infants perceive visual prosody in point-line displays of talking heads. PloS One, 9(10), e111467. 10.1371/journal.pone.0111467
    https://doi.org/10.1371/journal.pone.0111467 [Google Scholar]
72. Krahmer, E. J., & Swerts, M. G. J.
    (2007) The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57(3), 396–414. 10.1016/j.jml.2007.06.005
    https://doi.org/10.1016/j.jml.2007.06.005 [Google Scholar]
73. Krahmer, E. J., & Swerts, M. G. J.
    (2009) Audiovisual prosody: Introduction to the special issue. Language and Speech, 52(2–3), 129–133. 10.1177/0023830909103164
    https://doi.org/10.1177/0023830909103164 [Google Scholar]
74. Krifka, M.
    (2008) Basic notions of information structure. Acta Linguistica Hungarica, 55(3–4), 243–276. 10.1556/ALing.55.2008.3‑4.2
    https://doi.org/10.1556/ALing.55.2008.3-4.2 [Google Scholar]
75. Krivokapić, J., Tiede, M. K., & Tyrone, M. E.
    (2017) A kinematic study of prosodic structure in articulatory and manual gestures: Results from a novel method of data collection. Laboratory Phonology, 8(1), 3. 10.5334/labphon.75
    https://doi.org/10.5334/labphon.75 [Google Scholar]
76. Krivokapić, J., Tiede, M., Tyrone, M. E., Purse, R., & Seo, J.
    (2024) The role of prosodic structure in the planning of coordinated speech and manual gestures. Proceedings of the 12th International Conference on Speech Prosody 2024, 2–5 July 2024, Leiden, The Netherlands. 10.21437/SpeechProsody.2024‑140
    https://doi.org/10.21437/SpeechProsody.2024-140 [Google Scholar]
77. Kügler, K. & Calhoun, S.
    (2020) Prosodic encoding of information structure: A typological perspective. InC. Gussenhoven & A. Chen (Eds.), The Oxford handbook of language prosody, pp.454–467. Oxford University Press.
    [Google Scholar]
78. Leonard, T., & Cummins, F.
    (2010) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. 10.1080/01690965.2010.500218
    https://doi.org/10.1080/01690965.2010.500218 [Google Scholar]
79. Loehr, D.
    (2012) Temporal, structural, and pragmatic synchrony between intonation and gesture. Laboratory Phonology, 3(1), 71–89. 10.1515/lp‑2012‑0006
    https://doi.org/10.1515/lp-2012-0006 [Google Scholar]
80. Llanes-Coromina, J., Vilà-Giménez, I., Kushch, O., Borràs-Comes, J., Prieto, P.
    (2018) Beat gestures help preschoolers recall and comprehend discourse information. Journal of Experimental Child Psychology, 1721, 168–188. 10.1016/j.jecp.2018.02.004
    https://doi.org/10.1016/j.jecp.2018.02.004 [Google Scholar]
81. Lombart, C.
    (2023) Manual and nonmanual cues used for the prosodic encoding of contrastive focus in LSFB (French Belgian Sign Language). FEAST. Formal and Experimental Advances in Sign Language Theory51, 100-117.
    [Google Scholar]
82. Mathew, M., Yuen, I., & Demuth, K.
    (2017) Talking to the beat: Six-year-olds’ use of stroke-defined non-referential gestures. First Language, 0142723717734949.
    [Google Scholar]
83. Mathias, B., & von Kriegstein, K.
    (2023) Enriched learning: Behavior, brain, and computation. Trends in cognitive sciences, 27(1), 81–97. 10.1016/j.tics.2022.10.007
    https://doi.org/10.1016/j.tics.2022.10.007 [Google Scholar]
84. McGurk, H., & MacDonald, J.
    (1976) Hearing lips and seeing voices. Nature, 264(5588), 746–748. 10.1038/264746a0
    https://doi.org/10.1038/264746a0 [Google Scholar]
85. McNeill, D.
    (1992) Hand and mind: What gestures reveal about thought. University of Chicago Press.
    [Google Scholar]
86. McNeill, D.
    (2005) Gesture and thought. University of Chicago Press. 10.7208/chicago/9780226514642.001.0001
    https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
87. McNeill, N. M., Alibali, M. W., & Evans, J. L.
    (2000) The role of gesture in children’s comprehension of spoken language: Now they need it, now they don’t. Journal of Nonverbal Behavior, 24(2), 131–150. 10.1023/A:1006657929803
    https://doi.org/10.1023/A:1006657929803 [Google Scholar]
88. Morett, L. M., & Fraundorf, S. H.
    (2019) Listeners consider alternative speaker productions in discourse comprehension and memory: Evidence from beat gesture and pitch accenting. Memory & Cognition, 47(8), 1515–1530. 10.3758/s13421‑019‑00945‑1
    https://doi.org/10.3758/s13421-019-00945-1 [Google Scholar]
89. Morgenstern, A.
    (2022) Children’s multimodal language development from an interactional, usage-based, and cognitive perspective. Wiley Interdisciplinary Reviews. Cognitive science, 14(2). e1631. 10.1002/wcs.1631
    https://doi.org/10.1002/wcs.1631 [Google Scholar]
90. Munhall, K. G., Jones, J. A., Callan, D. E., Kuratate, T., & Vatikiotis-Bateson, E.
    (2004) Visual prosody and speech intelligibility. Psychological Science, 151, 133 — 137. 10.1111/j.0963‑7214.2004.01502010.x
    https://doi.org/10.1111/j.0963-7214.2004.01502010.x [Google Scholar]
91. Nakamura, C., Arai, M., Hirose, Y., & Flynn, S.
    (2020) An extra cue is beneficial for native speakers but can be disruptive for second language learners: Integration of prosody and visual context in syntactic ambiguity resolution. Frontiers in Psychology, 101, 2835. 10.3389/fpsyg.2019.02835
    https://doi.org/10.3389/fpsyg.2019.02835 [Google Scholar]
92. Nicoladis, E., Mayberry, R. I., & Genesee, F.
    (1999) Gesture and early bilingual development. Developmental Psychology, 35(2), 514–526. 10.1037/0012‑1649.35.2.514
    https://doi.org/10.1037/0012-1649.35.2.514 [Google Scholar]
93. Oller, D. K., Buder, E. H., Ramsdell, H. L., Warlaumont, A. S., & Chorna, L.
    (2013) Functional flexibility of infant vocalization and the emergence of language. PNAS, 110(16), 6318–6323. 10.1073/pnas.1300337110
    https://doi.org/10.1073/pnas.1300337110 [Google Scholar]
94. Özçalişkan, S., & Goldin-Meadow, S.
    (2005) Gesture is at the cutting edge of early language development. Cognition, 96(3), B101–13. 10.1016/j.cognition.2005.01.001
    https://doi.org/10.1016/j.cognition.2005.01.001 [Google Scholar]
95. Parrell, B., Goldstein, L., Lee, S., & Byrd, D.
    (2014) Spatiotemporal coupling between speech and manual motor actions. Journal of Phonetics, 421, 1–11. 10.1016/j.wocn.2013.11.002
    https://doi.org/10.1016/j.wocn.2013.11.002 [Google Scholar]
96. Pearson, L., & Pouw, W.
    (2022) Gesture-vocal coupling in Karnatak music performance: A neuro-bodily distributed aesthetic entanglement. Annals of the New York Academy of Sciences, 1515(1), 219–236. 10.1111/nyas.14806
    https://doi.org/10.1111/nyas.14806 [Google Scholar]
97. Pfau, R., & Quer, J.
    (2010) Nonmanuals: Their grammatical and prosodic roles. InD. Brentari (Ed.), Sign Languages, pp.381–402. Cambridge University Press. 10.1017/CBO9780511712203.018
    https://doi.org/10.1017/CBO9780511712203.018 [Google Scholar]
98. Pouw, W., de Jonge-Hoekstra, L., Harrison, S. J., Paxton, A., & Dixon, J. A.
    (2021) Gesture–speech physics in fluent speech and rhythmic upper limb movements. Annals of the New York Academy of Sciences, 1491(1), 89–105. 10.1111/nyas.14532
    https://doi.org/10.1111/nyas.14532 [Google Scholar]
99. Pouw, W., & Fuchs, S.
    (2022) Origins of vocal-entangled gesture. Neuroscience and biobehavioral reviews, 1411, 104836. 10.1016/j.neubiorev.2022.104836
    https://doi.org/10.1016/j.neubiorev.2022.104836 [Google Scholar]
100. Prieto, P.
     (2015) Intonational meaning. WIREs Cognitive Science, 6(4), 371–381. 10.1002/wcs.1352
     https://doi.org/10.1002/wcs.1352 [Google Scholar]
101. Prieto, P., Puglesi, C., Borràs-Comes, J., Arroyo, E., & Blat, J.
     (2015) Exploring the contribution of prosody and gesture to the perception of focus using an animated agent. Journal of Phonetics, 49 (1), 41–54. 10.1016/j.wocn.2014.10.005
     https://doi.org/10.1016/j.wocn.2014.10.005 [Google Scholar]
102. Prieto, P., & Roseano, P.
     (2021) The encoding of epistemic operations in two Romance languages: The interplay between intonation and discourse markers. Journal of Pragmatics, 1721, 146–163. 10.1016/j.pragma.2020.11.008
     https://doi.org/10.1016/j.pragma.2020.11.008 [Google Scholar]
103. Prieto, P., Borràs-Comes, J., Tubau, S., & Espinal, M. T.
     (2013) Prosody and gesture constrain the interpretation of double negation. Lingua, 1311, 136–150. 10.1016/j.lingua.2013.02.008
     https://doi.org/10.1016/j.lingua.2013.02.008 [Google Scholar]
104. Rohrer, P. L., Tüntüncübasi, U., Florit-Pons, J., Vilà-Giménez, I., Esteve-Gibert, N., Ren-Mitchell, A., Shattuck-Hufnagel, S., & Prieto, P.
     (2025) Multidimensional labeling of gesture in communication: the M3D proposal, Corpus Pragmatics.
     [Google Scholar]
105. Rohrer, P. L., E. Delais-Roussarie & P. Prieto
     (2023) Visualizing prosodic structure: Manual gestures as highlighters of prosodic heads and edges in English academic discourses, Lingua, 2931, 103583. 10.1016/j.lingua.2023.103583
     https://doi.org/10.1016/j.lingua.2023.103583 [Google Scholar]
106. Romøren, A. S., & Chen, A.
     (2015) Quiet is the new loud: pausing and focus in child and adult Dutch. Language and speech, 58 (1), 8–23. 10.1177/0023830914563589
     https://doi.org/10.1177/0023830914563589 [Google Scholar]
107. Roustan, B., & Dohen, M.
     (2010) Co-production of contrastive prosodic focus and manual gestures: Temporal coordination and effects on the acoustic and articulatory correlates of focus. Proceedings of the 5th International Conference on Speech Prosody, May 11–14 2010, Chicago, USA. 10.21437/SpeechProsody.2010‑246
     https://doi.org/10.21437/SpeechProsody.2010-246 [Google Scholar]
108. Rowe, M. L., & Goldin-Meadow, S.
     (2009) Early gesture selectively predicts later language learning. Developmental Science, 12(1), 182–187. 10.1111/j.1467‑7687.2008.00764.x
     https://doi.org/10.1111/j.1467-7687.2008.00764.x [Google Scholar]
109. Rusiewicz, H. L., & Esteve-Gibert, N.
     (2018) Set in time. Temporal coordination of prosody and gesture in the development of spoken language production. InP. Prieto & N. Esteve-Gibert (Eds.), The development of prosody in first language acquisition, pp.103–124. John Benjamins. 10.1075/tilar.23.06rus
     https://doi.org/10.1075/tilar.23.06rus [Google Scholar]
110. Sandler, W.
     (2010) Prosody and syntax in Sign Languages. Transactions of the Philological Society. Philological Society, 108(3), 298–328. 10.1111/j.1467‑968X.2010.01242.x
     https://doi.org/10.1111/j.1467-968X.2010.01242.x [Google Scholar]
111. Smith, L., & Gasser, M.
     (2005) The development of embodied cognition: six lessons from babies. Artificial life, 11(1–2), 13–29. 10.1162/1064546053278973
     https://doi.org/10.1162/1064546053278973 [Google Scholar]
112. Smith, N. A., & Strader, H. L.
     (2014) Infant-directed visual prosody: Mothers’ head movements and speech acoustics. Interaction Studies: Social Behaviour and Communication in Biological and Artificial Systems. 151, 38–54. 10.1075/is.15.1.02smi
     https://doi.org/10.1075/is.15.1.02smi [Google Scholar]
113. Shattuck-Hufnagel, S., & Prieto, P.
     (2019) Dimensionalizing co-speech gestures. InProceedings of the International Congress of Phonetic Sciences, 51, 1490–1494.
     [Google Scholar]
114. Shattuck-Hufnagel, S., & Ren, A.
     (2018) The prosodic characteristics of non-referential co-speech gestures in a sample of academic-lecture-style speech. Frontiers in Psychology, 91, 1514. 10.3389/fpsyg.2018.01514
     https://doi.org/10.3389/fpsyg.2018.01514 [Google Scholar]
115. So, W. C., Chen-Hui, C. S., & Wei-Shan, J. L.
     (2012) Mnemonic effect of iconic gesture and beat gesture in adults and children: Is meaning in gesture important for memory recall?Language and Cognitive Processes, 27(5), 665–681. 10.1080/01690965.2011.573220
     https://doi.org/10.1080/01690965.2011.573220 [Google Scholar]
116. Swerts, M. G. J., & Krahmer, E. J.
     (2005) Audiovisual prosody and feeling of knowing. Journal of Memory and Language, 53(1), 81–94. 10.1016/j.jml.2005.02.003
     https://doi.org/10.1016/j.jml.2005.02.003 [Google Scholar]
117. Sun, J., Wang, Z., & Tian, X.
     (2021) Manual Gestures Modulate Early Neural Responses in Loudness Perception. Frontiers in Neuroscience, 151, 634967. 10.3389/fnins.2021.634967
     https://doi.org/10.3389/fnins.2021.634967 [Google Scholar]
118. Thorson, J. C., & Morgan, J. L.
     (2021) Prosodic realizations of new, given, and corrective referents in the spontaneous speech of toddlers. Journal of Child Language, 48(3), 541–568. 10.1017/S0305000920000434
     https://doi.org/10.1017/S0305000920000434 [Google Scholar]
119. Turk, A., and Shattuck-Hufnagel, S.
     (2020) Speech timing: Implications for theories of phonology, phonetics, and speech motor control. Oxford University Press. 10.1093/oso/9780198795421.001.0001
     https://doi.org/10.1093/oso/9780198795421.001.0001 [Google Scholar]
120. Vilà-Giménez, I., & Prieto, P.
     (2021) The value of non-referential gestures: A systematic review of their cognitive and linguistic effects in children’s language development. Children, 8(2), 148. 10.3390/children8020148
     https://doi.org/10.3390/children8020148 [Google Scholar]
121. Wagner, P., Malisz, Z., & Kopp, S.
     (2014) Gesture and speech in interaction: An overview. Speech communication, 571, 209–232. 10.1016/j.specom.2013.09.008
     https://doi.org/10.1016/j.specom.2013.09.008 [Google Scholar]
122. Wakefield, J. C.
     (2020) Intonational morphology. Springer Nature. 10.1007/978‑981‑15‑2265‑9
     https://doi.org/10.1007/978-981-15-2265-9 [Google Scholar]
123. Wang, L., & Chu, M.
     (2013) The role of beat gesture and pitch accent in semantic processing: an ERP study. Neuropsychologia, 51 (13), 2847–2855. 10.1016/j.neuropsychologia.2013.09.027
     https://doi.org/10.1016/j.neuropsychologia.2013.09.027 [Google Scholar]
124. Wiedmann, N. & Winkler, S.
     (2015) The influence of prosody on children’s processing of ambiguous sentences. InS. Winkler (Ed.), Ambiguity: Language and communication, pp.185–198. De Gruyter Mouton. 10.1515/9783110403589‑009
     https://doi.org/10.1515/9783110403589-009 [Google Scholar]
125. Wightman CW, Shattuck-Hufnagel S, Ostendorf M, Price PJ
     (1992) Segmental durations in the vicinity of prosodic phrase boundaries. Journal of the Acoustical Society of America911, 1707–1717.
     [Google Scholar]
126. Wilbur, R. B.
     (2022) Prosody in Sign Languages. Hrvatska revija za rehabilitacijska istraživanja, 58 (Special Issue), 143–174. 10.31299/hrri.58.si.8
     https://doi.org/10.31299/hrri.58.si.8 [Google Scholar]
127. Wilbur, R. B.
     (2000) Phonological and prosodic layering of nonmanuals in American Sign Language. InK. Emmorey & H. Lane (Eds.), The signs of language revisited: An anthology to honor Ursula Bellugi and Edward Klima, pp.215–244. Lawrence Erlbaum Associates Publishers.
     [Google Scholar]
128. Żygis, M., & Fuchs, S.
     (2023) Communicative constraints affect oro-facial gestures and acoustics: Whispered vs normal speech. The Journal of the Acoustical Society of America, 153(1), 613–626. 10.1121/10.0015251
     https://doi.org/10.1121/10.0015251 [Google Scholar]