Volume 28, Issue 2
  • ISSN 0924-1884
  • E-ISSN: 1569-9986
Buy:$35.00 + Taxes


This paper will explore the multimodal approach to audiovisual translation (AVT). It must first be stressed, however, that most research on multimodality has not as yet focused on questions of translation. ( Jewitt 2009 ), which contains articles by most of the leading figures in the field, while representing a major step forward in multimodal studies, does not tackle translation head on. The word ‘translation’ does not even appear in the index. Over a relatively short time span, most of the major contributions to the field have been more purely linguistically based and intent on providing keys to the understanding of the interplay of semiotic resources such as words, images, gesture, music, light, etc. (see O’Toole 1994 ; Kress and van Leeuwen 1996 ; Martinec 2000 ; Unsworth 2001 ; Baldry and Thibault 2006 , etc.). The work of these scholars, however, has provided an impetus to developing ideas on how to exploit multimodal analyses in the area of AVT. Thibault’s work, for example, on the ‘multimodal transcription’ provided this author with the basis for investigating how the integration of semiotic modalities in a film text could assist the subtitler in making those all-important decisions on what to retain and what to discard when faced with time constraints. Other scholars have studied the co-articulation of words and image in their discussion of how different modalities realize social functions and make meaning ( O’Halloran 2008 ; Bednarek 2010 ), emphasising the importance of supplementing purely linguistic analyses with studies of all the other semiotic resources that make up a multimodal text. Findings will inevitably be reported verbally but the analyses need to explore the concept of integration and how other resources can interact with language and, crucially, how translators can be made sensitive to the entire semiotic impact of a multimodal text.


Article metrics loading...

Loading full text...

Full text loading...


  1. Baldry, Anthony
    ed. 2000Multimodality and Multimediality in the Distance Learning Age. Campobasso: Palladino Editore.
    [Google Scholar]
  2. 2002 “Subtitling Dynamic Multimodal Texts: The Development of Interactive Self-access Tools.” InThe Economy Principle in English: Linguistic, Literary and Cultural Perspectives, ed. by Giovanni Iamartino , Maria L. Bignami , and Carlo Pagetti , 54–62. Milan: Edizioni Unicopi.
    [Google Scholar]
  3. 2005A Multimodal Approach to Text Studies in English. Campobasso: Palladino Editore.
    [Google Scholar]
  4. Baldry, Anthony , and Paul Thibault
    2006Multimodal Transcription and Text Analysis. London: Equinox.
    [Google Scholar]
  5. Bateman, John
    2009 “Film and Representation: Making Filmic Meaning.” InMetarepresentation, Self-Organisation and Art, ed. by Wolfgang Wildgen , and Barend van Heusden , 137–162. Bern: Peter Lang.
    [Google Scholar]
  6. Bednarek, Monica
    2010The Language of Fictional Television: Drama and Identity. London: Continuum.
    [Google Scholar]
  7. Bordwell, David
    2008 “Three Dimensions of Film Narrative.” InPoetics of Cinema, 85–134. London: Routledge.
    [Google Scholar]
  8. Bruti, Silvia
    2006 “Cross-cultural Pragmatics: The Translation of Implicit Compliments in Subtitles.” Jostrans6: 185–197.
    [Google Scholar]
  9. Burczynska, Paulina
    2012Subtitling Humor. Saarbrücken: Lambert Academic Publishing.
    [Google Scholar]
  10. Cattrysse, Patrick , and Yves Gambier
    2008 “Screenwriting and Translating Screenplays.” InThe Didactics of Audiovisual Translation, ed. by Jorge Díz-Cintas , 39–55 New York: Routledge. doi: 10.1075/btl.77.06cat
    https://doi.org/10.1075/btl.77.06cat [Google Scholar]
  11. Fillmore, Charles
    1982 (2006) “Frame Semantics.” InCognitive Linguistics: Basic Readings, ed. by Dirk Geeraerts , 373–400. Berlin: Mouton de Gruyter.
    [Google Scholar]
  12. Flynn, Gillian
    2013Gone Girl. London: Phoenix.
    [Google Scholar]
  13. Fryer, Louise , and Jonathan Freeman
    2012 “Presence in Those with and without Sight: Audio Description and its Potential for Visual Reality Applications.” Journal of CyberTherapy and Rehabilitation5 (1): 15–23.
    [Google Scholar]
  14. Gambier, Yves
    2006 “Multimodality and Audiovisual Translation.” InAudiovisual Translation Scenarios: Proceedings of the Marie Curie Euroconferences MuTra: Audiovisual Translation Scenarios, Copenhagen 1–5 May 2006, ed. by Mary Carroll , Heidrun Gerzymisch-Arbogast , and Sandra Nauert . www.euroconferences.info/proceedings/2006_Proceedings/2006_proceedings.html. AccessedDecember 22, 2015.
    [Google Scholar]
  15. 2008 “Recent Developments and Challenges in Audiovisual Translation Research.” InBetween Text and Image: Updating Research in Screen Translation, ed. by Delia Chiaro , Christine Heiss , and Chiara Bucaria , 11–33. Amsterdam: John Benjamins. doi: 10.1075/btl.78.03gam
    https://doi.org/10.1075/btl.78.03gam [Google Scholar]
  16. 2013 “Moves towards Multimodality and Language Representation in Movies.” InReadings in Intersemiosis and Multimedia. Proceedings of the 3rd TICOM, Pavia, May 2006, ed. by Elena Montagna , 1–10. Pavia: Como.
    [Google Scholar]
  17. Gottlieb, Henrik
    1992 “Subtitling: A New University Discipline.” InTeaching Translation and Interpreting: Training Talent and Experience. Papers from the First Language International Conference, Elsinore, Denmark 1991, ed. by Cay Dollerup , and Anne Loddegaard , 161–170. Amsterdam: John Benjamins. doi: 10.1075/z.56.26got
    https://doi.org/10.1075/z.56.26got [Google Scholar]
  18. Gregory, Michael
    2002 “Phasal Analysis within Communication Linguistics: Two Contrastive Discourses.” InRelations and Functions within and around Language, ed. by Peter H. Fries , Michael Cumming , David Lockwood , and William Spruiell , 316–345. London: Continuum.
    [Google Scholar]
  19. Ivarsson, Jan
    1992Subtitling for the Media. A Handbook of an Art. Stockholm: Transedit.
    [Google Scholar]
  20. Jewitt, Carey
    ed. 2009The Routledge Handbook of Multimodal Analysis. Abingdon: Routledge.
    [Google Scholar]
  21. Kress, Gunther , and Theo van Leeuwen
    1996Reading Images: the Grammar of Visual Design. London: Routledge.
    [Google Scholar]
  22. 2001Multimodal Discourse: the Modes and Media of Contemporary Communication. London: Edward Arnold.
    [Google Scholar]
  23. Lomheim, Sylfest
    1999 “The Writing on the Screen. Subtitling: A Case Study from Norwegian Broadcasting (NRK), Oslo.” InWord, Text, Translation, ed. by Gunilla Anderman , and Margaret Rogers , 190–207. Clevedon: Multilingual Matters.
    [Google Scholar]
  24. Malcolm, Karen
    2010Phasal Analysis: Analysing Discourse through Communication Linguistics. London: Continuum.
    [Google Scholar]
  25. Martinec, Radan
    2000 “Rhythm in Multimodal Texts.” LEONARDO33 (4): 289–297.
    [Google Scholar]
  26. Mazur, Iwona
    2014 “Gestures and Facial Expressions in Audio Description.” InAudio Description: New Perspectives Illustrated, ed, by Anna Maszerowska , Anna Matamala , and Pilar Orero , 179–198. Amsterdam: John Benjamins.
    [Google Scholar]
  27. Minsky, Marvin
    1986The Society of Mind. New York: Simon and Schuster.
    [Google Scholar]
  28. O’Halloran, Kay
    2008Mathematical Discourse: Language, Symbolism and Visual Images. London: Continuum.
    [Google Scholar]
  29. O’Toole, Michael
    1994The Language of Displayed Art. London: Leicester University Press.
    [Google Scholar]
  30. Pedersen, Jan
    2011Subtitling Norms for Television: An Exploration Focussing on Extralinguistic Cultural References. Amsterdam: John Benjamins. doi: 10.1075/btl.98
    https://doi.org/10.1075/btl.98 [Google Scholar]
  31. Perego, Elisa
    2009 “The Codification of Non-Verbal Information in Subtitled Texts.” InNew Trends in Audiovisual Translation, ed. by Jorge D. Cintas , 58–69. Bristol: Multilingual Matters.
    [Google Scholar]
  32. Pettit, Zoe
    2013 “Language and Image: Translating the Audiovisual Text in Subtitling and Dubbing.” InReadings in Intersemiosis and Multimedia. Proceedings of the 3rd TICOM, Pavia, May 2006, ed. by Elena Montagna , 213–232. Pavia: Como.
    [Google Scholar]
  33. Ramière, Nathalie
    2006 “Reaching a Foreign Audience: Cultural Transfers in Audiovisual Translation.” Jostrans6: 152–166.
    [Google Scholar]
  34. Remael, Aline
    2008 “Screenwriting, Scripted and Unscripted Language: What do Subtitlers Need to Know?” InThe Didactics of Audiovisual Translation, ed. by Jorge Díaz Cintas , 57–67. Amsterdam: John Benjamins. doi: 10.1075/btl.77.07rem
    https://doi.org/10.1075/btl.77.07rem [Google Scholar]
  35. Snyder, Joel
    2005 “Audio Description. The Visual made Verbal across Arts Disciplines across the Globe.” Translating Today4: 15–17.
    [Google Scholar]
  36. Taylor, Christopher
    2003 “Multimodal Transcription in the Analysis, Translation and Subtitling of Italian Films.” The Translator9 (2): 191–206. doi: 10.1080/13556509.2003.10799153
    https://doi.org/10.1080/13556509.2003.10799153 [Google Scholar]
  37. 2004 “Multimodal Text Analysis and Subtitling.” InPerspectives on Multimodality, ed. by Eija Ventola , Cassily Charles , and Martin Kaltenbacher , 153–172. Amsterdam: John Benjamins. doi: 10.1075/ddcs.6.11tay
    https://doi.org/10.1075/ddcs.6.11tay [Google Scholar]
  38. Taylor Christopher
    2013 “Multimodality and Audiovisual Translation.” InHandbook of Translation Studies, ed. by Yves Gambier , and Luc van Doorslaer , vol.4, 98–104. Amsterdam: John Benjamins. doi: 10.1075/hts.4.mul2
    https://doi.org/10.1075/hts.4.mul2 [Google Scholar]
  39. Taylor, Christopher
    ed. Forthcoming (2016) A Text of Many Colours – Translating the Television Series ‘The West Wing’. Special issue ofIntralinea18.
    [Google Scholar]
  40. Thibault, Paul
    2000 “The Multimodal Transcription of a Television Advertisement: Theory and Practice.” InBaldry 2000, 311–385.
    [Google Scholar]
  41. Unsworth, Len
    2001Teaching Multiliteracies across the Curriculum: Changing Contexts of Text and Image in Classroom Practice. Buckingham: Open University Press.
    [Google Scholar]
  42. Wilken, Nicole , and Jan-Louis Kruger
    . Forthcoming (2016) “Putting the Audience in the Picture: Mise-en-shot and Psychological Immersion in Audio Described Film.” InEmpirical Approaches to Audiovisual Translation, ed. by Elisa Perego , special issue ofAcross Languages and Cultures17(2).
    [Google Scholar]

Data & Media loading...

  • Article Type: Research Article
Keyword(s): access; audiovisual translation; modes; multimodal texts; multimodal transcription
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error