Volume 4, Issue 2
  • ISSN 2589-7233
  • E-ISSN: 2589-7241
Buy:$35.00 + Taxes



This paper explores how emotion is conveyed in spoken language based on a sample of three stories for children read aloud by a trained storyteller. It draws on both Martin & White’s appraisal framework (2005) and a systematic account of vocal features. Interpreting and profiling emotion is a challenge both for researchers interested in spoken language and for English-as-an-additional-language teachers, when working to improve students’ spoken expression of emotion. Underpinning this challenge is the absence of a unified theoretical stance and a consequent lack of shared analytical tools for describing how speakers use semiotic resources to convey emotion in their speech. A systemic functional semiotic approach can make visible the co-patterning of wordings and vocalisations that express emotion.


Article metrics loading...

Loading full text...

Full text loading...


  1. Ariztimuño, Lilian I.
    2017 The expression of emotion in fairy tales: A multimodal approach to improve EFL students’ oral renderings. Phonetics Teaching and Learning Conference (PTLC2017) Proceedings, 11–15.
    [Google Scholar]
  2. Arnfield, Simon, Peter Roach, Jane Setter, Peter Greasley & Dave Horton
    1995 Emotional stress and speech tempo variation. ESCA-NATO Tutorial and research workshop on speech under stress, 13–15.
    [Google Scholar]
  3. Bednarek, Monika
    2008Emotion talk in corpora. Basingstoke/New York: Palgrave Macmillan. 10.1057/9780230285712
    https://doi.org/10.1057/9780230285712 [Google Scholar]
  4. Boersma, Paul & David Weenink
    2021 Praat: Doing phonetics by computer [Computer program]. Version 6.0. 38. https://www.fon.hum.uva.nl/praat/download_win.html
  5. Bombelli, Griselda, Lidia R. Soler & María S. Waasaf
    2013 The language of Evaluation: Paralinguistic features as a phonological domain for Appraisal. DELTA Documentação de Estudos em Lingüística Teórica e Aplicada29 (2). 267–280. 10.1590/S0102‑44502013000200004
    https://doi.org/10.1590/S0102-44502013000200004 [Google Scholar]
  6. Caldwell, David
    2014 The interpersonal voice: Applying appraisal to the rap and sung voice. Social Semiotics24 (1). 40–55. 10.1080/10350330.2013.827357
    https://doi.org/10.1080/10350330.2013.827357 [Google Scholar]
  7. Cruttenden, Alan
    2008Gimson’s pronunciation of English (7th edition). London: Hodder Education.
    [Google Scholar]
  8. Crystal, David & Randolph Quirk
    1964Systems of prosodic and paralinguistic features in English. The Hague: De Gruyter Mouton. 10.1515/9783112414989
    https://doi.org/10.1515/9783112414989 [Google Scholar]
  9. Douglas-Cowie, Ellen, Nick Campbell, Roddy Cowie & Peter Roach
    2003 Emotional speech: Towards a new generation of databases. Speech Communication40 (1). 33–60. 10.1016/S0167‑6393(02)00070‑5
    https://doi.org/10.1016/S0167-6393(02)00070-5 [Google Scholar]
  10. Eggins, Suzanne & Diana Slade
    2005Analysing casual conversation. London: Equinox.
    [Google Scholar]
  11. Ekman, Paul
    1999 Basic emotions. InTim Dalgleish & Mick Power (eds.), Handbook of cognition and emotion. Chichester: John Wiley & Sons. 10.1002/0470013494.ch3
    https://doi.org/10.1002/0470013494.ch3 [Google Scholar]
  12. Germani, Miriam P. & Lucía I. Rivas
    2017 A genre approach to prosody: Teaching intonation from a discourse perspective. Phonetics Teaching and Learning Conference (PTLC2017) Proceedings, 49–53.
    [Google Scholar]
  13. Halliday, Michael A. K.
    1970A course in spoken English: Intonation. London: OUP.
    [Google Scholar]
  14. 1978Language as social semiotic: The social interpretation of language and meaning. London: Hodder Education.
    [Google Scholar]
  15. 2003On language and linguistics, volume 3 in the collected works of M.A.K Halliday. Edited byJonathan J. Webster. London: Continuum.
    [Google Scholar]
  16. Halliday, Michael A. K. & William S. Greaves
    2008Intonation in the grammar of English. Equinox.
    [Google Scholar]
  17. Halliday, Michael A. K. & Ruqaiya Hasan
    1985Language, context, and text: Aspects of language in a social-semiotic perspective. Waurn Ponds, Victoria: Deakin University Press.
    [Google Scholar]
  18. Halliday, Michael A. K. & Christian M. I. M. Matthiessen
    2014Halliday’s introduction to functional grammar. London: Routledge. 10.4324/9780203783771
    https://doi.org/10.4324/9780203783771 [Google Scholar]
  19. Hasan, Ruqaiya
    1984 The nursery tale as a genre. Nottingham Linguistic Circular, 71–102.
    [Google Scholar]
  20. 1985Linguistics, language, and verbal art. Oxford: Oxford University Press.
    [Google Scholar]
  21. Humphrey, Sally & Shoshana Dreyfus
    2012 Exploring the interpretive genre in applied linguistics. Indonesian Journal of SFL1 (2). 156–174.
    [Google Scholar]
  22. Jewitt, Carey, Jeff Bezemer & Kay O’Halloran
    2016Introducing multimodality. London/New York: Routledge. 10.4324/9781315638027
    https://doi.org/10.4324/9781315638027 [Google Scholar]
  23. Johnstone, Tom, Van Reekum, Carien M. & Klaus R. Scherer
    2001 Vocal expression correlates of appraisal processes. InKlaus R. Scherer, Angela Schorr & Tom Johnstone (eds.), Appraisal processes in emotion: Theory, methods, research, 271–284. New York: Oxford University Press.
    [Google Scholar]
  24. Juslin, Patrik N. & Klaus R. Scherer
    2005Vocal expression of affect. InJinni A. Harrigan, Robert Rosenthal & Klaus R. Scherer (eds.), The new handbook of methods in nonverbal behavior research. Oxford: Oxford University Press. 10.1093/acprof:oso/9780198529620.003.0003
    https://doi.org/10.1093/acprof:oso/9780198529620.003.0003 [Google Scholar]
  25. Kress, Gunther R.
    2010Multimodality: A social semiotic approach to contemporary communication. New York: Routledge.
    [Google Scholar]
  26. Laukka, Petri, Hillary Anger Elfenbein, Nutankumar S. Thingujam, Thomas Rockstuhl, Frederick. K. Iraki, Wanda Chui & Jean Althoff
    2016 The expression and recognition of emotions in the voice across five nations: A lens model analysis based on acoustic features. Journal of Personality and Social Psychology111 (5). 686–705. 10.1037/pspi0000066
    https://doi.org/10.1037/pspi0000066 [Google Scholar]
  27. Lorette, Parnelle & Jean-Marc Dewaele
    2019 The relationship between bi/multilingualism, nativeness, proficiency and multimodal emotion recognition ability. International Journal of Bilingualism23 (6). 1502–1516. 10.1177/1367006918808042
    https://doi.org/10.1177/1367006918808042 [Google Scholar]
  28. Macken-Horarik, Mary
    2003 Appraisal and the special instructiveness of narrative. Text & Talk23 (2). 285–312. 10.1515/text.2003.012
    https://doi.org/10.1515/text.2003.012 [Google Scholar]
  29. Macken-Horarik, Mary & Anne Isaac
    2014 Appraising appraisal. InGeoff Thompson & Laura Alba-Juez (eds.), Evaluation in context. Amsterdam/Philadelphia: John Benjamins. 10.1075/pbns.242.04mac
    https://doi.org/10.1075/pbns.242.04mac [Google Scholar]
  30. Mackenzie, J. Lachlan & Laura Alba-Juez
    2019Emotion in discourse. Amsterdam/Philadelphia: John Benjamins. 10.1075/pbns.302
    https://doi.org/10.1075/pbns.302 [Google Scholar]
  31. Martin, James. R.
    2017 The discourse semantics of attitudinal relations: Continuing the study of lexis. Russian Journal of Linguistics21 (1). 22–47. 10.22363/2312‑9182‑2017‑21‑1‑22‑47
    https://doi.org/10.22363/2312-9182-2017-21-1-22-47 [Google Scholar]
  32. Martin, James R. & David Rose
    2008Genre relations: Mapping culture. London/Oakville: Equinox.
    [Google Scholar]
  33. Martin, James R. & Peter R. R. White
    2005The language of evaluation. Appraisal in English. Houndmills, UK: Palgrave Macmillan. 10.1057/9780230511910
    https://doi.org/10.1057/9780230511910 [Google Scholar]
  34. Martin, James R. & Michele Zappavigna
    2019 Embodied meaning: A systemic functional perspective on paralanguage. Functional Linguistics6 (1). 1–33. 10.1186/s40554‑018‑0065‑9
    https://doi.org/10.1186/s40554-018-0065-9 [Google Scholar]
  35. Matthiessen, Christian M. I. M.
    2009 Multisemiosis and context-based register typology. InEija Ventola & Arsenio J. M. Guijarro (eds.), The world told and the world shown: Multisemiotic issues. 11–38. London: Palgrave Macmillan.
    [Google Scholar]
  36. Mills, Kathy A. & Len Unsworth
    2016 Multimodal Literacy: Oxford Research Encyclopedia of Education. 10.1093/acrefore/9780190264093.013.232
    https://doi.org/10.1093/acrefore/9780190264093.013.232 [Google Scholar]
  37. 2017 iPad animations: Powerful multimodal practices for adolescent literacy and emotional language. Journal of Adolescent & Adult Literacy61 (6). 609–620. 10.1002/jaal.717
    https://doi.org/10.1002/jaal.717 [Google Scholar]
  38. Noad, Betty & Georgina Barton
    2018 Emotion resonance and divergence: A semiotic analysis of music and sound in “The Lost Thing” an animated short film and “Elizabeth” a film trailer. Social Semiotics30 (2). 206–224. 10.1080/10350330.2018.1543115
    https://doi.org/10.1080/10350330.2018.1543115 [Google Scholar]
  39. O’Grady, Gerard
    2010A grammar of spoken English: The intonation of increments. London: Continuum.
    [Google Scholar]
  40. 2020 Is there a role for prosody within register studies? And if so what and how?Language, Context and Text2 (1). 59–90. 10.1075/langct.00021.ogr
    https://doi.org/10.1075/langct.00021.ogr [Google Scholar]
  41. Painter, Clare, James. R. Martin & Len Unsworth
    2013Reading visual narratives: Image analysis of children’s picture books. Sheffield: Equinox.
    [Google Scholar]
  42. Pavlenko, Aneta
    2007Emotions and multilingualism. Cambridge: Cambridge University Press.
    [Google Scholar]
  43. Rintell, Ellen. M.
    1984 But how did you feel about that? The learner’s perception of emotion in speech. Applied Linguistics5 (3). 255–264. 10.1093/applin/5.3.255
    https://doi.org/10.1093/applin/5.3.255 [Google Scholar]
  44. Roach, Peter
    2000 Techniques for the phonetic description of emotional speech. InISCA Tutorial and Research Workshop (ITRW) on Speech and Emotion. 53–59.
    [Google Scholar]
  45. 2009English phonetics and phonology: A practical course. Cambridge: Cambridge University Press.
    [Google Scholar]
  46. Roach, Peter, Richard Stibbard, Jane Osborne, Simon Arnfield & Jane Setter
    1998 Transcription of prosodic and paralinguistic features of emotional speech. Journal of the International Phonetic Association28 (1–2). 83–94. 10.1017/S0025100300006277
    https://doi.org/10.1017/S0025100300006277 [Google Scholar]
  47. Royce, Terry D.
    2007 Multimodal communicative competence in second language contexts. InTerry D. Royce & Wendy L. Bowcher (eds.), New directions in the analysis of multimodal discourse. 361–390. Mahwah, NJ: Lawrence Erlbaum.
    [Google Scholar]
  48. Scherer, Klaus R.
    2003 Vocal communication of emotion: A review of research paradigms. Speech Communication40 (1–2). 227–256. 10.1016/S0167‑6393(02)00084‑5
    https://doi.org/10.1016/S0167-6393(02)00084-5 [Google Scholar]
  49. 2019 Acoustic patterning of emotion vocalizations. InSascha Fruhholz & Pascal Belin (eds.), The Oxford handbook of voice perception. 61–91. Oxford: OUP.
    [Google Scholar]
  50. Scherer, Klaus R. & Heiner Ellgring
    2007 Multimodal expression of emotion: Affect programs or componential appraisal patterns?Emotion7 (1). 158–171. 10.1037/1528‑3542.7.1.158
    https://doi.org/10.1037/1528-3542.7.1.158 [Google Scholar]
  51. Schuller, Björn, Anton Batliner, Stefan Steidl & Dino Seppi
    2011 Recognising realistic emotions and affect in speech: State of the art and lessons learnt from the first challenge. Speech Communication53 (9–10). 1062–1087. 10.1016/j.specom.2011.01.011
    https://doi.org/10.1016/j.specom.2011.01.011 [Google Scholar]
  52. Smith, Bradley A.
    2012 Speech and writing: Intonation within multimodal studies. InKay. L. O’Halloran & Bradley A. Smith (eds.), Multimodal studies: Exploring issues and domains. 291–313. London: Routledge.
    [Google Scholar]
  53. Smith, Bradley A. & William S. Greaves
    2015 Intonation. InJonathan J. Webster (ed.), The Bloomsbury companion to MAK Halliday. 291–313. London: Bloomsbury.
    [Google Scholar]
  54. Storynory
    Storynory 2013King Thrushbeard, The elves and the shoemaker, Rumpelstiltskin. Available athttps://www.storynory.com/category/fairy-tales/brothers-grimm/. (17 July, 2013.)
    [Google Scholar]
  55. Styler, Will
    2015 Using Praat for linguistic research. University of Colorado at Boulder Phonetics Laboratory. savethevowels.org/praat
    [Google Scholar]
  56. Tench, Paul
    1996The intonation systems of English. London: Cassell.
    [Google Scholar]
  57. 2014 A systemic functional model of the intonation of clauses in English. Readings in English Phonetics and Phonology (1). 261–296.
    [Google Scholar]
  58. Unsworth, Len & Kathy A. Mills
    2020 English language teaching of attitude and emotion in digital multimodal composition. Journal of Second Language Writing (47). 100712. 10.1016/j.jslw.2020.100712
    https://doi.org/10.1016/j.jslw.2020.100712 [Google Scholar]
  59. van Leeuwen, Theo
    1999Speech, music, sound. Basingstoke: Macmillan. 10.1007/978‑1‑349‑27700‑1
    https://doi.org/10.1007/978-1-349-27700-1 [Google Scholar]
  60. Zappavigna, Michele, Chris Cléirigh, Paul Dwyer & James R. Martin
    2010 Visualising appraisal prosody. InAhmar Mahboob & Naomi K. Knight (eds.), Appliable Linguistics: Texts, Contexts, and Meanings, 150–167. London & New York: Continuum.
    [Google Scholar]

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error