1887
Volume 18, Issue 2
  • ISSN 1877-9751
  • E-ISSN: 1877-976X
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Psycholinguistic evidence shows that spatial domains are automatically activated when processing temporal expressions. Speakers conceptualize time as a straight line deployed along different axes (mostly sagittal, though also vertical). The use of the lateral axis, which cannot be lexicalized in any language, has nonetheless been attested in temporal tasks in laboratories using a variety of experiments. This leads to the question of what axes are actually at work when conceptualizating time in oral communication.

The present study examines a great number of temporal expressions, taken from television shows, noting their associated co-speech gestures. Our results show that (1) speakers overwhelmingly use the lateral axis; (2) they are not performing simple space-to-time mappings, but are using instead a “timeline”, a material anchor which is a far more complex construct and that can explain some of the intricacies and contextual variations shown in the pattern of results.

Loading

Article metrics loading...

/content/journals/10.1075/rcl.00061.val
2020-12-04
2021-02-24
Loading full text...

Full text loading...

References

  1. Alibali, M. W., Bassok, M., Solomon, K. D., Syc, S. E., & Goldin-Meadow, S.
    (1999) Illuminating mental representations through speech and gesture. Psychological Science, 10, 327–333. 10.1111/1467‑9280.00163
    https://doi.org/10.1111/1467-9280.00163 [Google Scholar]
  2. Baldwin, D. A.
    (2002) The rise of intentional understanding: Analogies to the ontogenesis of language. InT. Givon & B. Malle (Eds.), The evolution of language out of prelanguage (pp.285–305). Amsterdam & Philadelphia: John Benjamins. 10.1075/tsl.53.15bal
    https://doi.org/10.1075/tsl.53.15bal [Google Scholar]
  3. Barrett, L.
    (2015) Beyond the brain: how body and environment shape animal and human minds. Princeton, NJ: Princeton University Press.
    [Google Scholar]
  4. Boroditsky, L., & Gaby, A.
    (2010) Remembrances of times east: Absolute spatial representations of time in an aboriginal Australian community. Psychological Science, 21, 1635–1639. doi: 10.1177/0956797610386621. 10.1177/0956797610386621
    https://doi.org/10.1177/0956797610386621 [Google Scholar]
  5. Boroditsky, L., Fuhrman, O., & McCormick, K.
    (2011) Do English and Mandarin speakers think about time differently?Cognition, 118(1), 126–132. 10.1016/j.cognition.2010.09.010
    https://doi.org/10.1016/j.cognition.2010.09.010 [Google Scholar]
  6. Bressem, J.
    (2013) A linguistic perspective on the notation of form features in gestures. InC. Müller, A. J. Cienki, E. Fricke, S. H. Ladewig, D. McNeill & S. Teßendorf (Eds.), Body – language – communication. An international handbook on multimodality in human interaction (pp.1079–1098). Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  7. Brewer, M.
    (2000) Research design and issues of validity. InH. Reis & C. Judd (Eds.), Handbook of research methods in social and personality psychology (pp.11–26). Cambridge: Cambridge University Press.
    [Google Scholar]
  8. Calbris, G.
    (1990) The semiotics of French gesture. Bloomington & Indianapolis: Indiana University Press.
    [Google Scholar]
  9. (2011) Elements of meaning in gesture. Amsterdam & Philadelphia: John Benjamins. 10.1075/gs.5
    https://doi.org/10.1075/gs.5 [Google Scholar]
  10. Casasanto, D.
    (2009) When is a linguistic metaphor a conceptual metaphor?InV. Evans & S. Pourcel (Eds.), New directions in Cognitive Linguistics (pp.127–145). Amsterdam & Philadelphia: John Benjamins. 10.1075/hcp.24.11cas
    https://doi.org/10.1075/hcp.24.11cas [Google Scholar]
  11. Casasanto, D., & Boroditsky, L.
    (2008) Time in the mind: using space to think about time. Cognition, 106, 579–93. 10.1016/j.cognition.2007.03.004
    https://doi.org/10.1016/j.cognition.2007.03.004 [Google Scholar]
  12. Casasanto, D., & Bottini, R.
    (2014) Mirror-reading can reverse the flow of time. Journal of Experimental Psychology: General, 143(2), 473–479. 10.1037/a0033297
    https://doi.org/10.1037/a0033297 [Google Scholar]
  13. Casasanto, D., & Jasmin, K.
    (2012) The hands of time: Temporal gestures in English speakers. Cognitive Linguistics, 23(4), 643–674. 10.1515/cog‑2012‑0020
    https://doi.org/10.1515/cog-2012-0020 [Google Scholar]
  14. Cienki, A.
    (1998) Metaphoric gestures and some of their relations to verbal metaphoric expressions. InJ. -P. Koenig (Ed.), Discourse and cognition: bridging the gap (pp.189–204). Stanford, CA: CSLI Publications.
    [Google Scholar]
  15. Cienki, A., & Müller, C.
    (2008) Metaphor, gesture and thought. InR. W. Gibbs (Ed), Cambridge handbook of metaphor and thought (pp.483–501). Cambridge: Cambridge University Press. 10.1017/CBO9780511816802.029
    https://doi.org/10.1017/CBO9780511816802.029 [Google Scholar]
  16. Clark, A.
    (2008) Supersizing the mind: Embodiment, action and cognitive extension. Oxford: Oxford University Press. 10.1093/acprof:oso/9780195333213.001.0001
    https://doi.org/10.1093/acprof:oso/9780195333213.001.0001 [Google Scholar]
  17. Clark, H. H.
    (1996) Using language. Cambridge: Cambridge University Press. 10.1017/CBO9780511620539
    https://doi.org/10.1017/CBO9780511620539 [Google Scholar]
  18. Cooperrider, K., & Nuñez, R.
    (2009) Across time, across the body: transversal temporal gestures. Gesture, 9, 181–206. 10.1075/gest.9.2.02coo
    https://doi.org/10.1075/gest.9.2.02coo [Google Scholar]
  19. Coulson, S., & Pagán-Cánovas, C.
    (2013) Understanding timelines: Conceptual metaphor and conceptual integration. Cognitive Semiotics, 5(1–2), 198–219.
    [Google Scholar]
  20. Dancygier, B.
    (2012) The language of stories. Cambridge: Cambridge University Press.
    [Google Scholar]
  21. Dancygier, B., & Sweetser, E.
    (Eds.) (2012) Viewpoint in language: A multimodal perspective. Cambridge: Cambridge University Press. 10.1017/CBO9781139084727
    https://doi.org/10.1017/CBO9781139084727 [Google Scholar]
  22. Dirven, R., & Parings, R.
    (Eds.) (2002) Metaphor and metonymy in comparison and contrast. Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  23. Engberg-Pedersen, E.
    (1993) Space in Danish sign language: The semantics and morphosyntax of the use of space in a visual language. Hamburg: SIGNUM-Verlag.
    [Google Scholar]
  24. (1999) Space and time. InJ. Allwood & P. Gardenfors (Eds.), Cognitive semantics: Meaning and cognition (pp.131–152). Amsterdam & Philadelphia: John Benjamins. 10.1075/pbns.55.07eng
    https://doi.org/10.1075/pbns.55.07eng [Google Scholar]
  25. Emmorey, K.
    (2001) Space on hand: The exploitation of signing space to illustrate abstract thought. InM. Gattis (Ed.), Spatial schemas and abstract thought (pp.147–174). Cambridge: The MIT Press.
    [Google Scholar]
  26. Fauconnier, G.
    (1997) Mappings in thought and language. Cambridge: Cambridge University Press. 10.1017/CBO9781139174220
    https://doi.org/10.1017/CBO9781139174220 [Google Scholar]
  27. Fauconnier, G., & Turner, M.
    (1998) Conceptual integration networks. Cognitive Science, 22(2), 133–187. 10.1207/s15516709cog2202_1
    https://doi.org/10.1207/s15516709cog2202_1 [Google Scholar]
  28. (2002) The way we think: Conceptual blending and the mind’s hidden complexities. New York: Basic Books.
    [Google Scholar]
  29. Fillmore, C. J., Kay, P., & O’Connor, M.
    (1988) Regularity and idiomaticity in grammatical constructions: The case of let alone. Language, 64(3), 501–538. 10.2307/414531
    https://doi.org/10.2307/414531 [Google Scholar]
  30. Fuhrman, O., & Boroditsky, L.
    (2010) Cross-cultural differences in mental representations of time: Evidence from an implicit nonlinguistic task. Cognitive Science, 34, 1430–1451. doi:  10.1111/j.1551‑6709.2010.01105.x
    https://doi.org/10.1111/j.1551-6709.2010.01105.x [Google Scholar]
  31. Goldberg, A.
    (1995) Constructions: A Construction Grammar approach to argument structure. Chicago: University of Chicago Press.
    [Google Scholar]
  32. (2006) Constructions at work. Oxford: Oxford University Press.
    [Google Scholar]
  33. Goldin-Meadow, S., & Alibali, M. W.
    (2013) Gesture’s role in speaking, learning, and creating language. Annual Review of Psychology, 123, 448–453.
    [Google Scholar]
  34. Goldin-Meadow, S.
    (2003) Gesture. Encyclopedia of cognitive science, volume2 (pp.289–293). London: Macmillan Reference Ltd.
    [Google Scholar]
  35. Hutchins, E.
    (2005) Material anchors for conceptual blends. Journal of Pragmatics, 37, 1555–1577. 10.1016/j.pragma.2004.06.008
    https://doi.org/10.1016/j.pragma.2004.06.008 [Google Scholar]
  36. Ishihara, M., Keller, P. E., Rossetti, Y. & Prinz, W.
    (2008) Horizontal spatial representations of time: Evidence for the STEARC effect. Cortex, 44(4), 454–461. 10.1016/j.cortex.2007.08.010
    https://doi.org/10.1016/j.cortex.2007.08.010 [Google Scholar]
  37. Jewitt, C.
    (Ed.) (2009) The Routledge handbook of multimodal analysis. London: Routledge.
    [Google Scholar]
  38. Kendon, A.
    (1995) Gestures as illocutionary and discourse structure markers in Southern Italian conversation. Journal of Pragmatics, 23(3), 247–279. 10.1016/0378‑2166(94)00037‑F
    https://doi.org/10.1016/0378-2166(94)00037-F [Google Scholar]
  39. (2004) Gesture: Visible action as utterance. Cambridge: Cambridge University Press. 10.1017/CBO9780511807572
    https://doi.org/10.1017/CBO9780511807572 [Google Scholar]
  40. Kita, S.
    (2009) Cross-cultural variation of speech-accompanying gesture: a review. Language and Cognitive Processes, 24(2), 145–167. 10.1080/01690960802586188
    https://doi.org/10.1080/01690960802586188 [Google Scholar]
  41. Kövecses, Z.
    (2005) Metaphor in culture. Universality and variation. Cambridge: Cambridge University Press. 10.1017/CBO9780511614408
    https://doi.org/10.1017/CBO9780511614408 [Google Scholar]
  42. Lakoff, G.
    (1993) The contemporary theory of metaphor. InA. Ortony (Ed.), Metaphor and thought (pp.202–251). Cambridge: Cambridge University Press. 10.1017/CBO9781139173865.013
    https://doi.org/10.1017/CBO9781139173865.013 [Google Scholar]
  43. Lakoff, G., & Johnson, M.
    (1980) Metaphors we live by. Chicago: University of Chicago Press.
    [Google Scholar]
  44. (1999) Philosophy in the flesh. New York: Basic Books.
    [Google Scholar]
  45. Le Guen, O., & Pool Balam, L. I.
    (2012) No metaphorical timeline in gesture and cognition among Yucatec Mayas. Frontiers in Cultural Psychology, 3, Article 271. doi:  10.3389/fpsyg.2012.00271
    https://doi.org/10.3389/fpsyg.2012.00271 [Google Scholar]
  46. Leonard, T., & Cummins, F.
    (2011) The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26(10), 1457–1471. 10.1080/01690965.2010.500218
    https://doi.org/10.1080/01690965.2010.500218 [Google Scholar]
  47. Levinson, S. C.
    (1996) Frames of reference and Molyneux’s question: Cross-linguistic evidence. InP. Bloom, M. Peterson, L. Nadel & M. Garrett (Eds.), Language and space (pp.109–169). Cambridge, MA: MIT Press.
    [Google Scholar]
  48. McNeill, D.
    (1992) Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
    [Google Scholar]
  49. (2005) Gesture and thought. Chicago: University of Chicago Press. 10.7208/chicago/9780226514642.001.0001
    https://doi.org/10.7208/chicago/9780226514642.001.0001 [Google Scholar]
  50. (2013) Gesture as a window onto mind and brain, and the relationship to linguistic creativity and ontogenesis. InC. Müller, A. J. Cienki, E. Fricke, S. H. Ladewig, D. McNeill & S. Teßendorf (Eds.), Body – language – communication. An international handbook on multimodality in human interaction. Volume I (pp.28–54). Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  51. Müller, C., Cienki, A., Fricke, E., Ladewig, S. H., McNeill, D., & Bressem, J.
    (Eds.) (2013) Body – language – communication. An international handbook on multimodality in human interaction. Volume II. Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  52. (Eds.) (2014) Body – language – communication. An international handbook on multimodality in human interaction. Volume II. Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  53. Núñez, R., & Sweetser, E.
    (2006) With the future behind them: Convergent evidence from Aymara language and gesture in the crosslinguistic comparison of spatial construals of time. Cognitive Science, 30, 401–450. 10.1207/s15516709cog0000_62
    https://doi.org/10.1207/s15516709cog0000_62 [Google Scholar]
  54. Ouellet, M., Santiago, J., Israeli, Z., & Gabay, S.
    (2010) Is the future the right time?Experimental Psychology, 57, 308–314. doi:  10.1027/1618‑3169/a000036
    https://doi.org/10.1027/1618-3169/a000036 [Google Scholar]
  55. Pagán Cánovas, C., Valenzuela, J., & Santiago, J.
    (2015) Like the machete the snake: Integration of topic and vehicle in poetry comprehension reveals meaning construction processes. Psychology of Aesthetics, Creativity, and the Arts, 9(4), 385–393. 10.1037/aca0000024
    https://doi.org/10.1037/aca0000024 [Google Scholar]
  56. Pagán-Cánovas, C., & Valenzuela, J.
    (2017) Timelines and multimodal constructions: facing new challenges. Linguistics Vanguard, 3(1). doi:  10.1515/lingvan‑2016‑0087
    https://doi.org/10.1515/lingvan-2016-0087 [Google Scholar]
  57. Pagán-Cánovas, C., Valenzuela, J., Alcaraz-Carrión, D., Olza, I., & Ramscar, M.
    (2020) Quantifying the speech-gesture relation with massive multimodal datasets: Informativity in time expressions. PLoS ONE, 15(6), e0233892. doi:  10.1371/journal.pone.0233892
    https://doi.org/10.1371/journal.pone.0233892 [Google Scholar]
  58. Radden, G.
    (2004) The metaphor TIME AS SPACE across languages. InN. Baumgarten, C. Böttger, M. Motz & J. Probst (Eds.), Übersetzen, interkulturelle Kommunikation, Spracherwerb und Sprachvermittlung – Das Leben mit Mehreren Sprachen: Festschrift für Juliane House zum 60 Geburtstag (pp.225–238). Bochum, Germany: Aks-Verlag.
    [Google Scholar]
  59. Richter, N.
    (2014) Structuring discourse: Observations on prosody and gesture in Russian TV-discourse. InC. Müller, A. J. Cienki, E. Fricke, S. H. Ladewig, D. McNeill & S. Teßendorf (Eds.), Body – language – communication. An international handbook on multimodality in human interaction. Volume II (pp.1392–1400). Berlin & New York: Mouton de Gruyter.
    [Google Scholar]
  60. Santiago, J., Lupiáñez, J., Perez, E., & Funes, M. J.
    (2007) Time (also) flies from left to right. Psychonomic Bulletin & Review, 14(3), 512–516. 10.3758/BF03194099
    https://doi.org/10.3758/BF03194099 [Google Scholar]
  61. Santiago, J., Román, A., & Ouellet, M.
    (2011) Flexible foundations of abstract thought: A review and a theory. Spatial Dimensions of Social Thought, 41–110.
    [Google Scholar]
  62. Scott, A.
    (1989) The vertical dimension and time in Mandarin. Australian Journal of Linguistics, 9, 295–331. 10.1080/07268608908599424
    https://doi.org/10.1080/07268608908599424 [Google Scholar]
  63. Sell, A. J., & Kaschak, M. P.
    (2011) Processing time shifts affects the execution of motor responses. Brain & Language, 117, 39–44. 10.1016/j.bandl.2010.07.003
    https://doi.org/10.1016/j.bandl.2010.07.003 [Google Scholar]
  64. Sinha, C., Silva Sinha, V. da, Zinken, J., & Sampaio, W.
    (2011) When time is not space: The social and linguistic construction of time intervals and temporal event relations in an Amazonian culture. Language and Cognition, 3(1), 137–169. 10.1515/langcog.2011.006
    https://doi.org/10.1515/langcog.2011.006 [Google Scholar]
  65. Steen, F., & Turner, M.
    (2013) Multimodal Construction Grammar. InM. Borkent, B. Dancygier, & J. Hinnell (Eds.), Language and the creative mind (pp.255–274). Stanford: CSLI Publications.
    [Google Scholar]
  66. Stockwell, P.
    (1999) The inflexibility of invariance. Language and Literature, 8(2), 125–142. 10.1177/096394709900800202
    https://doi.org/10.1177/096394709900800202 [Google Scholar]
  67. Torralbo, A., Santiago, J., & Lupiáñez, J.
    (2006) Flexible conceptual projection of time onto spatial frames of reference. Cognitive Science, 30(4), 745–757. 10.1207/s15516709cog0000_67
    https://doi.org/10.1207/s15516709cog0000_67 [Google Scholar]
  68. Turner, M.
    (1996) The literary mind. New York: Oxford University Press US.
    [Google Scholar]
  69. (2014) The origin of ideas: blending, creativity, and the human spark. New York: Oxford University Press US.
    [Google Scholar]
  70. Ulrich, R., Eikmeier, V., Vega, I., Ruiz Fernández, S., Alex-Ruf, S., & Maienborn, C.
    (2012) With the past behind and the future ahead: Back-to-front representation of past and future sentences. Memory & Cognition, 40(3), 483–495. 10.3758/s13421‑011‑0162‑4
    https://doi.org/10.3758/s13421-011-0162-4 [Google Scholar]
  71. Ulrich, R., & Maienborn, C.
    (2010) Left–right coding of past and future in language: The mental timeline during sentence processing. Cognition, 117, 126–138. 10.1016/j.cognition.2010.08.001
    https://doi.org/10.1016/j.cognition.2010.08.001 [Google Scholar]
  72. Valenzuela, J., Hilferty, J., & Garachana, M.
    (2005) On the reality of grammatical constructions. Annual Review of Cognitive Linguistics, 3, 201–215. 10.1075/arcl.3.11val
    https://doi.org/10.1075/arcl.3.11val [Google Scholar]
  73. Walker, E., & Cooperrider, K.
    (2015) The continuity of metaphor: evidence from temporal gestures. Cognitive Science, 40(2), 481–495. 10.1111/cogs.12254
    https://doi.org/10.1111/cogs.12254 [Google Scholar]
  74. Weger, U. W., & Jay, P.
    (2008) Time flies like an arrow: Space–time compatibility effects suggest the use of a mental timeline. Psychonomic Bulletin and Review, 15(2), 426–430. 10.3758/PBR.15.2.426
    https://doi.org/10.3758/PBR.15.2.426 [Google Scholar]
  75. Wang, L., & Chu, M.
    (2013) The role of beat gesture and pitch accent in semantic processing: an ERP study. Neuropsychologia, 51(13), 2847–55. 10.1016/j.neuropsychologia.2013.09.027
    https://doi.org/10.1016/j.neuropsychologia.2013.09.027 [Google Scholar]
  76. Zhang, J., & Patel, V. L.
    (2006) Distributed cognition, representation, and affordance. Pragmatics & Cognition, 14(2), 333–341. 10.1075/pc.14.2.12zha
    https://doi.org/10.1075/pc.14.2.12zha [Google Scholar]
  77. Zima, E.
    (2014) Gibt es multimodale Konstruktionen? Eine Studie zu [V(motion) in circles] und [all the way from X PREP Y]. Gesprächsforschung – Online-Zeitschrift zur verbalen Interaktion, 15, 1–48.
    [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/rcl.00061.val
Loading
/content/journals/10.1075/rcl.00061.val
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): co-speech gestures , material anchors , space-to-time metaphors , time conceptualization and timelines
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error