1887
  1. Home
  2. e-Journals
  3. Babel
  4. Volume 70, Issue 1
  5. Article
Volume 70, Issue 1-2
  • ISSN 0521-9744
  • E-ISSN: 1569-9668
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This article explores how a corpus-based approach allows us to describe and analyze the multimodal complexity of graphic elements in creative subtitling. To this end, the article focuses on a YouTube channel, , featuring a dog and its owner. This channel’s subtitling strategies were experimental with multiple graphic elements (colors, positions, font sizes, and emojis). Informed by a social semiotic approach to multimodality, a corpus of 1,155 coupled pairs of Chinese-English subtitles was annotated for modal shifts and metafunctional shifts. Some major findings include: (a) emojis were much more likely to be added to the target subtitles for the animals than for the humans; (b) speaker-identifying graphic elements (color and position) were lost in the target subtitles, but emojis were systematically added to mark animals as the speakers; (c) the addition of emojis evoked complementary-interpersonal meanings, suggesting that the subtitlers might have prioritized audience engagement over textual fidelity; (d) although the target subtitles used fewer graphic elements, the semiotic meanings could be similar or complementary to those of the source subtitles. Based on these findings, the article also discusses the opportunities and challenges of a corpus-based approach to graphic elements in creative subtitling.

© Fédération Internationale des Traducteurs (FIT) Revue Babel
Loading

Article metrics loading...

/content/journals/10.1075/babel.00382.wu
2023-12-15
2024-10-03

  • From This Site

    /content/journals/10.1075/babel.00382.wu
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Video links for the examples in Figure 3.
  2. Example 1: https://www.youtube.com/watch?v=woiY8H0wLJ4 (2:44)
  3. Example 2: https://www.youtube.com/watch?v=Y2rChaREC5g (1:20)
  4. Example 3: https://www.youtube.com/watch?v=G_rOvmYpwZ8 (0:12)
  5. Example 4: https://www.youtube.com/watch?v=mu6pmo4e3ek (0:05)
  6. Agresti, Alan
    2013 Categorical Data Analysis. Hoboken: John Wiley & Sons.
     [Google Scholar]
  7. Baños, Rocío, Silvia Bruti, and Serenella Zanotti
    2013 “Corpus Linguistics and Audiovisual Translation: In Search of an Integrated Approach.” Perspectives21 (4): 483–490. 10.1080/0907676X.2013.831926
     https://doi.org/10.1080/0907676X.2013.831926 [Google Scholar]
  8. Bassnett, Susan, Lawrence Venuti, Jan Pedersen, and Ivana Hostová
    2022 “Translation and Creativity in the 21st Century.” World Literature Studies14 (1): 3–17. 10.31577/WLS.2022.14.1.1
     https://doi.org/10.31577/WLS.2022.14.1.1 [Google Scholar]
  9. Bateman, John
    2008 Multimodality and Genre: A Foundation for the Systematic Analysis of Multimodal Documents. London: Palgrave Macmillan. 10.1057/9780230582323
     https://doi.org/10.1057/9780230582323 [Google Scholar]
  10. Bateman, John A.
    2014 “Using Multimodal Corpora for Empirical Research.” InThe Routledge Handbook of Multimodal Analysis, edited byCarey Jewitt, 238–252. London: Routledge.
     [Google Scholar]
  11. Beckman, Rachel
    2008 “An Out-of-Character Role for Subtitles.” Washington Post, 14November. https://www.washingtonpost.com/wpdyn/content/article/2008/11/14/AR2008111400700.html
     [Google Scholar]
  12. Bernardini, Silvia, and Adriano Ferraresi
    2022 “Corpus Linguistics.” InThe Routledge Handbook of Translation and Methodology, edited byFederico Zanettin and Christopher Rundle, 207–222. London: Routledge. 10.4324/9781315158945‑16
     https://doi.org/10.4324/9781315158945-16 [Google Scholar]
  13. Brookes, Gavin, and Tony McEnery
    2020 “Corpus Linguistics.” InThe Routledge Handbook of English Language and Digital Humanities, edited bySvenja Adolphs and Dawn Knight, 378–404. London: Routledge. 10.4324/9781003031758‑20
     https://doi.org/10.4324/9781003031758-20 [Google Scholar]
  14. Bruti, Silvia
    2020 “Corpus Approaches and Audiovisual Translation.” InThe Palgrave Handbook of Audiovisual Translation and Media Accessibility, edited byŁukasz Bogucki and Mikołaj Deckert, 381–395. Cham: Palgrave Macmillan. 10.1007/978‑3‑030‑42105‑2_19
     https://doi.org/10.1007/978-3-030-42105-2_19 [Google Scholar]
  15. Bywood, Lindsay
    2019 “Testing The Retranslation Hypothesis for Audiovisual Translation: The Films of Volker Schlöndorff Subtitled into English.” Perspectives27 (6): 815–832. 10.1080/0907676X.2019.1593467
     https://doi.org/10.1080/0907676X.2019.1593467 [Google Scholar]
  16. Chen, Yuping
    2019 Translating Film Subtitles into Chinese: A Multimodal Study. Singapore: Springer. 10.1007/978‑981‑13‑6108‑1
     https://doi.org/10.1007/978-981-13-6108-1 [Google Scholar]
  17. Cohn, Neil
    2013 “Beyond Speech Balloons and Thought Bubbles: The Integration of Text and Image.” Semiotica1971: 35–63. 10.1515/sem‑2013‑0079
     https://doi.org/10.1515/sem-2013-0079 [Google Scholar]
  18. Dahne, Annie, and Roberta Piazza
    2020 “‘Subtitles Have to Become My Ears Not My Eyes’ Pragmatic-Stylistic Choices behind Closed Captions for the Deaf and Hard of Hearing: The Example of Breaking Bad.” InTelecinematic Stylistics, edited byChristian Hoffmann and Monika Kirner-Ludwig, 285–306. London: Bloomsbury. 10.5040/9781350042889.0018
     https://doi.org/10.5040/9781350042889.0018 [Google Scholar]
  19. Danesi, Marcel
    2017 The Semiotics of Emoji: The Rise of Visual Language in the Age of the Internet. London: Bloomsbury. 10.5040/9781474282024
     https://doi.org/10.5040/9781474282024 [Google Scholar]
  20. De Linde, Zoé, and Neil Kay
    1999 “Processing Subtitles and Film Images: Hearing vs Deaf Viewers.” The Translator5 (1): 45–60. 10.1080/13556509.1999.10799033
     https://doi.org/10.1080/13556509.1999.10799033 [Google Scholar]
  21. Díaz Cintas, Jorge
    2018 “‘Subtitling’s a Carnival’: New Practices in Cyberspace.” The Journal of Specialised Translation301: 127–149.
     [Google Scholar]
  22. Díaz Cintas, Jorge, and Aline Remael
    2021 Subtitling: Concepts and Practices. London: Routledge.
     [Google Scholar]
  23. Dwyer, Tessa
    2017 Speaking in Subtitles: Revaluing Screen Translation. Edinburgh: Edinburgh University Press.
     [Google Scholar]
  24. Field, Andy
    2018 Discovering Statistics Using IBM SPSS Statistics, 5th ed.Los Angeles: Sage.
     [Google Scholar]
  25. Foerster, Anna
    2010 “Towards a Creative Approach in Subtitling: A Case Study.” InNew Insights into Audiovisual Translation and Media Accessibility, edited byJorge Díaz Cintas, Anna Matamala, and Josélia Neves, 81–98. Amsterdam: Rodopi. 10.1163/9789042031814_008
     https://doi.org/10.1163/9789042031814_008 [Google Scholar]
  26. Fox, Wendy
    2016 “Integrated Titles: An Improved Viewing Experience.” InEyetracking and Applied Linguistics, edited bySilvia Hansen-Schirra and Sambor Grucza, 5–29. Berlin: Language Science Press.
     [Google Scholar]
  27. 2018 Can Integrated Titles Improve the Viewing Experience? Investigating the Impact of Subtitling on the Reception and Enjoyment of Film Using Eye Tracking and Questionnaire Data. Berlin: Language Science Press.
     [Google Scholar]
  28. Gambier, Yves
    2003 “Introduction: Screen Transadaptation: Perception and Reception. Special Issue on Screen Translation.” The Translator9 (2): 171–190. 10.1080/13556509.2003.10799152
     https://doi.org/10.1080/13556509.2003.10799152 [Google Scholar]
  29. 2013 “The Position of Audiovisual Translation Studies.” InThe Routledge Handbook of Translation Studies, edited byCarmen Millán and Francesca Bartrina, 45–59. London: Routledge. 10.1075/hts.4
     https://doi.org/10.1075/hts.4 [Google Scholar]
  30. Guillot, Marie-Noëlle
    2019 “Subtitling on the Cusp of its Futures.” InThe Routledge Handbook of Audiovisual Translation, edited byLuis Pérez-González, 31–47. London: Routledge.
     [Google Scholar]
  31. Halliday, Michael Alexander Kirkwood
    1978 Language as Social Semiotic: The Social Interpretation of Language and Meaning. London: Edward Arnold.
     [Google Scholar]
  32. 2001 “Towards a Theory of Good Translation.” InExploring Translation and Multilingual Text Production: Beyond Content, edited byErich Steiner and Colin Yallop, 13–18. Berlin: Mouton de Gruyter. 10.1515/9783110866193.13
     https://doi.org/10.1515/9783110866193.13 [Google Scholar]
  33. Halliday, Michael Alexander Kirkwood, and Christian M. I. M. Matthiessen
    2014 Halliday’s Introduction to Functional Grammar. London: Routledge. 10.4324/9780203783771
     https://doi.org/10.4324/9780203783771 [Google Scholar]
  34. Hart, Christopher
    2020 “Multimodal Discourse Analysis.” InResearching Discourse: A Student Guide, edited byChristopher Hart, 143–179. London: Routledge. 10.4324/9780367815042‑9
     https://doi.org/10.4324/9780367815042-9 [Google Scholar]
  35. Jewitt, Carey, Jeff Bezemer, and Kay O’Halloran
    2016 Introducing Multimodality. London: Routledge. 10.4324/9781315638027
     https://doi.org/10.4324/9781315638027 [Google Scholar]
  36. Kress, Gunther
    2010 Multimodality: A Social Semiotic Approach to Contemporary Communication. London: Routledge.
     [Google Scholar]
  37. 2014 “What Is a Mode?” InThe Routledge Handbook of Multimodal Analysis, edited byCarey Jewitt, 2nd ed., 60–75. London: Routledge.
     [Google Scholar]
  38. 2020 “Transposing Meaning: Translation in a Multimodal Semiotic Landscape.” InTranslation and Multimodality: Beyond Words, edited byMonica Boria, Ángeles Carreres, María Noriega-Sánchez, and Marcus Tomalin, 24–48. London: Routledge.
     [Google Scholar]
  39. Kress, Gunther, and Theo van Leeuwen
    2006 Reading Images: The Grammar of Visual Design, 2nd ed. London: Routledge. 10.4324/9780203619728
     https://doi.org/10.4324/9780203619728 [Google Scholar]
  40. Kruger, Jan-Louis
    2021 “Translation, Multimodality and Cognition.” InThe Routledge Handbook of Translation and Cognition, edited byFabio Alves and Arnt Lykke Jakobsen, 433–444. London: Routledge.
     [Google Scholar]
  41. Levshina, Natalia
    2017 “Online Film Subtitles as A Corpus: An N-Gram Approach.” Corpora12 (3): 311–338. 10.3366/cor.2017.0123
     https://doi.org/10.3366/cor.2017.0123 [Google Scholar]
  42. Logi, Lorenzo, and Michele Zappavigna
    2021 “A Social Semiotic Perspective on Emoji: How Emoji and Language Interact to Make Meaning in Digital Messages.” New Media & Society25 (12): 3222–3246. 10.1177/14614448211032965
     https://doi.org/10.1177/14614448211032965 [Google Scholar]
  43. Malamatidou, Sofia
    2018 Corpus Triangulation: Combining Data and Methods in Corpus-Based Translation Studies. London: Routledge.
     [Google Scholar]
  44. Matthiessen, Christian M. I. M.
    2021 “Translation, Multilingual Text Production and Cognition Viewed in Terms of Systemic Functional Linguistics.” InThe Routledge Handbook of Translation and Cognition, edited byFabio Alves and Arnt Lykke Jakobsen, 517–544. London: Routledge.
     [Google Scholar]
  45. McClarty, Rebecca
    2012 “Towards A Multidisciplinary Approach in Creative Subtitling.” MonTI: Monografías de traducción e interpretación41: 133–153. 10.6035/MonTI.2012.4.6
     https://doi.org/10.6035/MonTI.2012.4.6 [Google Scholar]
  46. 2014 “In Support of Creative Subtitling: Contemporary Context and Theoretical Framework.” Perspectives22 (4): 592–606. 10.1080/0907676X.2013.842258
     https://doi.org/10.1080/0907676X.2013.842258 [Google Scholar]
  47. McEnery, Tony, and Andrew Hardie
    2012 Corpus Linguistics: Method, Theory and Practice. Cambridge: Cambridge University Press.
     [Google Scholar]
  48. Miles, Matthew B., and A. Michael Huberman
    1994 Qualitative Data Analysis: An Expanded Sourcebook. 2 ed.Thousand Oaks, CA: Sage.
     [Google Scholar]
  49. Mubenga, Kajingulu
    2009 “Towards a Multimodal Pragmatic Analysis of Film Discourse in Audiovisual Translation.” Meta54 (3): 466–484. 10.7202/038309ar
     https://doi.org/10.7202/038309ar [Google Scholar]
  50. Nornes, Abé Mark
    1999 “For an Abusive Subtitling.” Film Quarterly52 (3): 17–34. 10.2307/1213822
     https://doi.org/10.2307/1213822 [Google Scholar]
  51. Pavesi, Maria
    2019 “Corpus-Based Audiovisual Translation Studies: Ample Room for Development.” InThe Routledge Handbook of Audiovisual Translation, edited byLuis Pérez-González, 315–333. London: Routledge.
     [Google Scholar]
  52. 2022 “Corpora and The Language of Films: Exploring Dialogue in English and Italian.” InThe Routledge Handbook of Corpus Linguistics, 2nd ed., edited byAnne O’Keeffe and Michael J. McCarthy, 547–561. London: Routledge. 10.4324/9780367076399‑38
     https://doi.org/10.4324/9780367076399-38 [Google Scholar]
  53. Pedersen, Jan
    2011 Subtitling Norms for Television: An Exploration Focussing on Extralinguistic Cultural References. Amsterdam and Philadelphia: John Benjamins Publishing Company. 10.1075/btl.98
     https://doi.org/10.1075/btl.98 [Google Scholar]
  54. Perego, Elisa
    2019 “Into the Language of Museum Audio Descriptions: A Corpus-Based Study.” Perspectives27 (3): 333–349. 10.1080/0907676X.2018.1544648
     https://doi.org/10.1080/0907676X.2018.1544648 [Google Scholar]
  55. Pérez-González, Luis
    2007 “Appraising Dubbed Conversation: Systemic Functional Insights into the Construal of Naturalness in Translated Film Dialogue.” The Translator13 (1): 1–38. 10.1080/13556509.2007.10799227
     https://doi.org/10.1080/13556509.2007.10799227 [Google Scholar]
  56. 2014 Audiovisual Translation: Theories, Methods and Issues. London: Routledge. 10.4324/9781315762975
     https://doi.org/10.4324/9781315762975 [Google Scholar]
  57. Pinnow, Rachel J.
    2015 “A Patriot is Respectful: (Re-)Examining the Architecture of Ideology in Educational Contexts.” InInternational Handbook of Semiotics, edited byPeter Pericles Trifonas, 1249–1269. New York: Springer. 10.1007/978‑94‑017‑9404‑6_60
     https://doi.org/10.1007/978-94-017-9404-6_60 [Google Scholar]
  58. Pinto, Sara Ramos, and Aishah Mubaraki
    2020 “Multimodal Corpus Analysis of Subtitling: The Case of Non-Standard Varieties.” Target32 (3): 389–419. 10.1075/target.18085.ram
     https://doi.org/10.1075/target.18085.ram [Google Scholar]
  59. Remael, Aline, and Nina Reviers
    2020 “Media Accessibility and Accessible Design.” InThe Routledge Handbook of Translation and Technology, edited byMinako O’Hagan, 482–497. London: Routledge.
     [Google Scholar]
  60. Reviers, Nina
    2018 “Studying the Language of Dutch Audio Description: An Example of a Corpus-Based Analysis.” Translation and Translanguaging in Multilingual Contexts41: 178–202. 10.1075/ttmc.00009.rev
     https://doi.org/10.1075/ttmc.00009.rev [Google Scholar]
  61. Romero-Fresco, Pablo
    2009 “Naturalness in the Spanish Dubbing Language: A Case of Not-so-close Friends,” Meta54 (1), 49–72. 10.7202/029793ar
     https://doi.org/10.7202/029793ar [Google Scholar]
  62. Secară, Alina
    2011 “RU Ready 4 New Subtitles? Investigating the Potential of Social Translation Practices and Creative Spellings.” Linguistica Antverpiensia, New Series–Themes in Translation Studies101: 153–171.
     [Google Scholar]
  63. Soffritti, Marcello
    2019 “Multimodal Corpora in Audiovisual Translation Studies.” InThe Routledge Handbook of Audiovisual Translation, edited byLuis Pérez-González, 334–349. London: Routledge.
     [Google Scholar]
  64. Sun, Juhyung, Sarah Lasser, and Sun Kyong Lee
    2022 “Understanding Emojis: Cultural Influences in Interpretation and Choice of Emojis.” Journal of International and Intercultural Communication16 (3): 246–261.
     [Google Scholar]
  65. Taylor, Christopher
    2003 “Multimodal Transcription in the Analysis, Translation and Subtitling of Italian Films.” The Translator9 (2): 191–205. 10.1080/13556509.2003.10799153
     https://doi.org/10.1080/13556509.2003.10799153 [Google Scholar]
  66. 2013 “Multimodality and Audiovisual Translation.” InHandbook of Translation Studies, vol. 41, edited byYves Gambier and Luc van Doorslaer, 98–104. Amsterdam and Philadelphia: John Benjamins Publishing Company. 10.1075/hts.4.mul2
     https://doi.org/10.1075/hts.4.mul2 [Google Scholar]
  67. 2016 “The Multimodal Approach in Audiovisual Translation.” Target28 (2): 222–236. 10.1075/target.28.2.04tay
     https://doi.org/10.1075/target.28.2.04tay [Google Scholar]
  68. 2020 “Multimodality and Intersemiotic Translation.” InThe Palgrave Handbook of Audiovisual Translation and Media Accessibility, edited byŁukasz Bogucki and Mikołaj Deckert, 83–99. Cham: Palgrave Macmillan. 10.1007/978‑3‑030‑42105‑2_5
     https://doi.org/10.1007/978-3-030-42105-2_5 [Google Scholar]
  69. Thompson, Paul
    2022 “Building A Specialised Audiovisual Corpus.” InThe Routledge Handbook of Corpus Linguistics (2nd edition), edited byAnne O’Keeffe and Michael J. McCarthy, 75–88. London: Routledge. 10.4324/9780367076399‑7
     https://doi.org/10.4324/9780367076399-7 [Google Scholar]
  70. Tirkkonen-Condit, Sonja, and Jukka Mäkisalo
    2007 “Cohesion in Subtitles: A Corpus-Based Study.” Across Languages and Cultures8 (2): 221–230. 10.1556/Acr.8.2007.2.4
     https://doi.org/10.1556/Acr.8.2007.2.4 [Google Scholar]
  71. Tognini-Bonelli, Elena
    2001 Corpus Linguistics at Work. Amsterdam and Philadelphia: John Benjamins Publishing Company. 10.1075/scl.6
     https://doi.org/10.1075/scl.6 [Google Scholar]
  72. Toury, Gideon
    2012 Descriptive Translation Studies and Beyond, rev. ed.Amsterdam and Philadelphia: John Benjamins Publishing Company. 10.1075/btl.100
     https://doi.org/10.1075/btl.100 [Google Scholar]
  73. Tuominen, Tiina, Catalina Jiménez Hurtado, and Anne Ketola
    2018 “Why Methods Matter: Approaching Multimodality in Translation Research.” Linguistica Antverpiensia: New Series–Themes in Translation Studies171: 1–21.
     [Google Scholar]
  74. Valentini, Cristina
    2007 “Developing AVT Corpora for a Quantitative Approach to Language Transfer in Cinematic Products.” InSelected Papers of the CETRA Research Seminar in Translation Studies 2006, edited byFrancis Mus, 1–18. Leuven: CETRA.
     [Google Scholar]
  75. Wu, Zhiwei, and Zhuojia Chen
    2022 “Towards a Corpus-Driven Approach to Audiovisual Translation (AVT) Reception: A Case Study of YouTube Viewer Comments.” The Journal of Specialised Translation381: 128–154.
     [Google Scholar]
  76. Xavier, Catarina
    2022 “A Three-Layered Typology for the Subtitling of Taboo: A Corpus-Based Proposal of Methods, Strategies, and Techniques.” Babel68 (4): 586–609. 10.1075/babel.00283.xav
     https://doi.org/10.1075/babel.00283.xav [Google Scholar]
  77. Zanettin, Federico
    2012 Translation-Driven Corpora: Corpus Resources for Descriptive and Applied Translation Studies. Manchester: St. Jerome.
     [Google Scholar]
/content/journals/10.1075/babel.00382.wu
Loading
Towards a corpus-based approach to graphic elements in creative subtitling
Babel 70, 138 (2024); https://doi.org/10.1075/babel.00382.wu
/content/journals/10.1075/babel.00382.wu
/content/journals/10.1075/babel.00382.wu
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): corpus; creative subtitling; graphic elements; metafunction; mode; multimodality; multimodalité; méta-fonction; sous-titrage créatif; éléments graphiques

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error