1887
Volume 11, Issue 2
  • ISSN 2352-1805
  • E-ISSN: 2352-1813
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Multimodality has both challenged traditional text analysis strategies and offered a new scenario for the study of emotions in texts. In accessible translation, emotions are presented in different modes and thus intersemiosis is key to the success of the accessible translated text. The aim of this article is to study emotions in the accessible subtitling and audio description of texts that include affective elements from the perspective of the seven standards of textuality proposed by Beaugrande and Dressler (1981).

Following a multimodal and intersemiotic approach, we first describe how emotions are represented in the multimodal lexical resource developed within the Lexemos project, and report a didactic experience carried out in an undergraduate Multimedia Translation module with 86 students. Second, we present how the standards of textuality are a solid foundation for decision making when translating emotionally-laden multimodal texts and adapting them to users with different needs and abilities. Third, we propose a workflow for the identification and analysis of emotions in multimodal materials that has been used for the teaching of audiovisual translation. The results show that the transmission of emotions and the transfer of meaning, functions and intentions are key to building a coherent text, improving user experience and allowing access to culture and knowledge in accessible translation practices

Loading

Article metrics loading...

/content/journals/10.1075/ttmc.00160.lop
2025-03-20
2025-04-25
Loading full text...

Full text loading...

References

  1. Arndt, Horst, and Richard W. Janney
    1987InterGrammar. Towards an Integrative Model of Verbal, Prosodic and Kinesic Choices in Speech. Berlin: Mouton de Gruyter.
    [Google Scholar]
  2. Beaugrande, Robert de
    1997New Foundations for a Science of Text and Discourse: Cognition, Communication, and the Freedom of Access to Knowledge and Society. New York: Ablex.
    [Google Scholar]
  3. Beaugrande, Robert de, and Wolfgang Ulrich Dressler
    1981Introduction to Text Linguistics. 3rd ed.London: Longman.
    [Google Scholar]
  4. Bednarek, Monika
    2008Emotion Talk Across Corpora. London: Palgrave Macmillan. 10.1057/9780230285712
    https://doi.org/10.1057/9780230285712 [Google Scholar]
  5. 2010The Language of Fictional Television: Drama and Identity. London: Continuum.
    [Google Scholar]
  6. Damasio, Antonio
    2005 “Feeling Our Emotions.” Scientific American Mind16 (1): 14–15. 10.1038/scientificamericanmind0405‑14
    https://doi.org/10.1038/scientificamericanmind0405-14 [Google Scholar]
  7. 2018The Strange Order of Things: Life, Feeling, and the Making of Cultures. New York: Pantheon Books.
    [Google Scholar]
  8. Described and Captioned Media Program
    Described and Captioned Media Program (n. d.). Description Key — How to Describe. https://dcmp.org/learn/descriptionkey/617
    [Google Scholar]
  9. Díaz-Cintas, Jorge, and Aline Remael
    2021Subtitling: Concepts and Practices. London: Routledge.
    [Google Scholar]
  10. Eckkrammer, Eva Martha
    2004 “Drawing on Theories of Inter-semiotic Layering to Analyse Multimodality in Medical Self-Counselling Texts and Hypertexts.” InPerspectives on Multimodality, ed. byEija Ventola, Cassily Charles, and Martin Kaltenbacher, 211–226. Amsterdam: John Benjamins. 10.1075/ddcs.6.14eck
    https://doi.org/10.1075/ddcs.6.14eck [Google Scholar]
  11. European Master’s in Translation Expert Group
    European Master’s in Translation Expert Group 2022Competence Framework 2022. Brussels: European Master’s in Translation. https://commission.europa.eu/news/updated-version-emt-competence-framework-now-available-2022-10-21_en
    [Google Scholar]
  12. Halliday, Michael A. K., and Ruqaiya Hasan
    1976Cohesion in English. London: Longman.
    [Google Scholar]
  13. IASC MHPSS RG — Inter-Agency Standing Committee Reference Group on Mental Health and Psychosocial Support in Emergency Settings
    IASC MHPSS RG — Inter-Agency Standing Committee Reference Group on Mental Health and Psychosocial Support in Emergency Settings 2021Highlights One Year on from the Release of the IASC MHPSS RG Children’s Storybook on COVID-19 in April 2020. AccessedJuly 2, 2023. https://bit.ly/3Gp2Zxf
    [Google Scholar]
  14. Iglesias Carrillo, Ximena, and Maribel Tercedor-Sánchez
    2014 “Acceso a la salud por parte de la población indígena mayahablante en México: elaboración de materiales didácticos desde la interculturalidad.” PanaceaXV (40): 235–242.
    [Google Scholar]
  15. Jakobson, Roman
    1959 “On Linguistic Aspects of Translation.” InOn Translation, ed. byReuben Arthur Brower, 232–239. Cambridge, MA: Harvard University Press.
    [Google Scholar]
  16. Jiménez-Hurtado, Catalina
    ed. 2007Traducción y accesibilidad: Subtitulación para sordos y audiodescripción para ciegos. Nuevas modalidades de Traducción Audiovisual. Frankfurt: Peter Lang. 10.52034/lanstts.v17i0
    https://doi.org/10.52034/lanstts.v17i0 [Google Scholar]
  17. Jiménez-Hurtado, Catalina, Tiina Tuominen, and Anne Ketola
    2018 “Methods for the Study of Multimodality in Translation.” Linguistica Anverpiensia New Series171:1–21. https://lans-tts.uantwerpen.be/index.php/LANS-TTS/issue/view/19
    [Google Scholar]
  18. Kress, Gunther, and Theo Van Leeuwen
    2001Multimodal Discourse: The Modes and Media of Contemporary Communication. Oxford: Oxford University Press.
    [Google Scholar]
  19. Liu, Yu, and Kay L. O’Halloran
    2009 “Intersemiotic Texture: Analyzing Cohesive Devices between Language and Images.” Social Semiotics19 (4): 367–388. 10.1080/10350330903361059
    https://doi.org/10.1080/10350330903361059 [Google Scholar]
  20. López-Rodríguez, Clara Inés
    2022 “Emotion at the End of Life: Semantic Annotation and Key Domains in a Pilot Study Audiovisual Corpus.” Lingua2771: 103401. 10.1016/j.lingua.2022.103401
    https://doi.org/10.1016/j.lingua.2022.103401 [Google Scholar]
  21. 2023Localización para lingüistas y traductores. Granada: Comares.
    [Google Scholar]
  22. López-Rodríguez, Clara Inés, Juan Antonio Prieto-Velasco, and Maribel Tercedor-Sánchez
    2013 “Multimodal Representation of Specialized Knowledge in Ontology-Based Terminological Databases: The Case of EcoLexicon.” The Journal of Specialized Translation (JoSTrans)201: 49–67. https://jostrans.soap2.ch/issue20/art_lopez.pdf
    [Google Scholar]
  23. López-Rodríguez, Clara Inés, and Maribel Tercedor-Sánchez
    2020 “El sonido de las emociones: aproximación intersemiótica al subtitulado accesible de Roma por parte de traductores”. InNuevas tendencias en Traducción e Interpretación. Enseñar, aprender e investigar en la Revolución Digital, ed. bySilvia Martínez Martínez, 29–49. Granada: Comares.
    [Google Scholar]
  24. 2022a “La accesibilidad como eje transversal en el aula de Traducción Multimedia.” InInvestigaciones recientes en Traducción y Accesibilidad digital, ed. byMaría del Mar Sánchez Ramos, 101–124. Berlin: Peter Lang. 10.3726/b19995
    https://doi.org/10.3726/b19995 [Google Scholar]
  25. 2022b “Caracterización léxico-semántica de emociones para comunicación interlingüística inglés-español.” Pragmalingüística301: 261–282. 10.25267/Pragmalinguistica.2022.i30.12
    https://doi.org/10.25267/Pragmalinguistica.2022.i30.12 [Google Scholar]
  26. Martínez Sierra, Juan José
    2004Estudio descriptivo y discursivo de la traducción del humor en textos audiovisuales. El caso de los Simpson. Castellón: Universidad Jaume I.
    [Google Scholar]
  27. Neelsen, Sandro
    2021 “What is a Plurisemiotic Work in Translation?” The Journal of Specialized Translation (JoSTrans)351: 17–30. https://jostrans.org/issue35/art_neelsen.php
    [Google Scholar]
  28. O’Halloran, Kay L.
    2011 “Multimodal Discourse Analysis.” InThe Continuum Companion to Discourse Analysis, ed. byKen Hyland, and Brian Paltridge, 120–137. London: Continuum.
    [Google Scholar]
  29. Remael, Aline, and Nina Reviers
    2018 “Multimodality and Audiovisual Translation: Cohesion in Accessible Films.” InThe Routledge Handbook of Audiovisual Translation, ed. byLuis Pérez González, 260–280. London: Routledge. 10.4324/9781315717166‑17
    https://doi.org/10.4324/9781315717166-17 [Google Scholar]
  30. Sasamoto, Ryoko, and Stephen Doherty
    2016 “Towards the Optimal Use of Impact Captions on TV Programmes.” InConflict and Communication: A Changing Asia in a Globalising World, ed. byMinako O’Hagan, and Qi Zhang, 210–247. New York: Nova Science Publishers.
    [Google Scholar]
  31. Searle, John R.
    1969Speech Acts: An Essay in the Philosophy of Language. Cambridge: Cambridge University Press. 10.1017/CBO9781139173438
    https://doi.org/10.1017/CBO9781139173438 [Google Scholar]
  32. Tercedor-Sánchez, Maribel, Clara Inés López-Rodríguez, and Juan Antonio Prieto-Velasco
    2007 “Accesibilidad web y material multimedia: la descripción de imágenes.” InAccesibilidad a los medios audiovisuales para personas con discapacidad, ed. byBelén Ruiz Mezcua, and Francisco Utray Delgado, 73–82. Madrid: Real Patronato sobre discapacidad.
    [Google Scholar]
  33. WHO
    WHO 2020Doing What Matters in Times of Stress: An Illustrated Guide. Geneva: World Health Organization.
    [Google Scholar]
  34. Zabrocka, Monika
    2018 “Rhymed and Traditional Audio Description according to the Blind and Partially Sighted Audience: Results of a Pilot Study on Creative Audio Description.” The Journal of Specialized Translation (JoSTrans)291: 212–236. https://www.jostrans.soap2.ch/issue29/art_zabrocka.pdf
    [Google Scholar]
/content/journals/10.1075/ttmc.00160.lop
Loading
/content/journals/10.1075/ttmc.00160.lop
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): accessibility; emotions; multimodal translation; standards of textuality
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error