Volume 1, Issue 1
  • ISSN 2542-5277
  • E-ISSN: 2542-5285
Buy:$35.00 + Taxes


The present research triangulates questionnaire, retrospective interview and eyetracking data, aiming to investigate how Explanatory Captions (ECs) are received by different viewers with varied educational backgrounds, and whether or not the presence of ECs improves their understanding of the AV content. The results show that the provision of ECs, for a subtitled video in a foreign language, greatly increased on the viewers. Viewers tend to reduce time spent on viewing images, but invest additional processing effort on the ECs, although their allocation of processing effort on subtitles experienced little change. Furthermore, the eyetracking data suggest that most participants adopted a fixed reading pattern on subtitles and ECs when they appeared simultaneously, which could balance some of the negative impact of ECs on their viewing experience. The findings gained through this experimental research will provide some guidance and suggestions for subtitlers when preparing subtitles and ECs.


Article metrics loading...

Loading full text...

Full text loading...


  1. Bisson, Marie-Josée , Walter J. B. Van Heuven , Kathy Conklin , and Richard J. Tunney
    2014 “Processing of Native and Foreign Language Subtitles in Films: An Eye Tracking Study.” Applied Psycholinguistics35 (2): 399–418. doi:10.1017/S0142716412000434
    https://doi.org/10.1017/S0142716412000434 [Google Scholar]
  2. Braun, Sabine
    2016 “The Importance of Being Relevant? A Cognitive-Pragmatic Framework for Conceptualising Audiovisual Translation.” Target28 (2): 302–313. doi: 10.1075/target.28.2.10bra
    https://doi.org/10.1075/target.28.2.10bra [Google Scholar]
  3. Caffrey, Colm
    2012 “Using an Eye–tracking Tool to Measure the Effects of Experimental Subtitling Procedures on Viewer Perception of Subtitled AV Content.” InEye-tracking in Audiovisual Translation. Edited by E. Perego , 135–156. Roma: Aracne.
    [Google Scholar]
  4. Dwyer, Tessa
    2015 “From Subtitles to SMS: Eye Tracking, Texting and Sherlock .” Refractory: A Journal of Entertainment Media, 25. Accessed11 Nov 2017: refractory.unimelb.edu.au/2015/02/07/dwyer/
    [Google Scholar]
  5. d’Ydewalle, Géry , and Ingrid Gielen
    1992 “Attention Allocation with Overlapping Sound, Image, and Text.” InEye Movements and Visual Cognition: Scene Perception and Reading. Edited by K. Rayner , 415–427. New York: Springer. doi:10.1007/978‑1‑4612‑2852‑3_25
    https://doi.org/10.1007/978-1-4612-2852-3_25 [Google Scholar]
  6. d’Ydewalle, Géry , and Wim De Bruycker
    2007 “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist12 (3): 196–205. doi:10.1027/1016‑9040.12.3.196
    https://doi.org/10.1027/1016-9040.12.3.196 [Google Scholar]
  7. d’Ydewalle, Géry , Johan van Rensbergen , and Joris Pollet
    1987 “Reading a Message When the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” InEye Movements: From Physiology to Cognition. Edited by J. K. O’Regan and A. Lévy—Schoen , 313–321. Amsterdam: North—Holland. doi:10.1016/B978‑0‑444‑70113‑8.50047‑3
    https://doi.org/10.1016/B978-0-444-70113-8.50047-3 [Google Scholar]
  8. de Linde, Zoe , and Neil M. Kay
    1999The Semiotics of Subtitling. Manchester: St. Jerome.
    [Google Scholar]
  9. Desilla, Louisa
    2012 “Implicatures in Film: Construal and Functions in Bridget Jones Romantic Comedies.” Journal of Pragmatics44: 30–53. doi:10.1016/j.pragma.2011.10.002
    https://doi.org/10.1016/j.pragma.2011.10.002 [Google Scholar]
  10. Ghia, Elisa
    2012 “The Impact of Translation Strategies on Subtitle Reading.” InEye-tracking in Audiovisual Translation. Edited by E. Perego , 157–182. Roma: Aracne.
    [Google Scholar]
  11. Hegarty, Mary
    1992 “The Mechanics of Comprehension and Comprehension of Mechanics.” InEye Movements and Visual Cognition: Scene Perception and Reading. Edited by K. Rayner , 428–443. New York: Springer. doi:10.1007/978‑1‑4612‑2852‑3_26
    https://doi.org/10.1007/978-1-4612-2852-3_26 [Google Scholar]
  12. Hsiao, Chi-hua
    2014The Cultural Translation of U.S. Television Programs and Movies: Subtitle Groups as Cultural Brokers in China. PhD Thesis, University of California, Los Angeles.
    [Google Scholar]
  13. Hvelplund, Kristian Tangsgaard
    2011Allocation of Cognitive Resources in Translation: An Eye-tracking and Key-logging Study. PhD thesis, Copenhagen Business School.
    [Google Scholar]
  14. 2014 “Eye Tracking and the Translation Process: Reflections on the Analysis and Interpretation of Eye-tracking Data. InMinding Translation. Edited by R. Muñoz , 201–223. MonTI, special issue 1. Alicante: Universidad de Alicante.
    [Google Scholar]
  15. Kruger, Jan-Louis , Esté Hefer , and Gordon Matthew
    2013 “Measuring the Impact of Subtitles on Cognitive Load: Eye Tracking and Dynamic Audiovisual Texts.” Proceedings of the 2013 Conference on Eye Tracking South Africa, 62–66. New York: ACM. doi:10.1145/2509315.2509331
    https://doi.org/10.1145/2509315.2509331 [Google Scholar]
  16. Lautenbacher, Olli Philippe
    2012 “From Still Pictures to Moving Pictures.” InEye-tracking in Audiovisual Translation. Edited by E. Perego , 135–155. Roma: Aracne.
    [Google Scholar]
  17. Moran, Siobhan
    2012 “The Effect of Linguistic Variation on Subtitle Reception.” InEye-tracking in Audiovisual Translation. Edited by E. Perego , 183–222. Roma: Aracne.
    [Google Scholar]
  18. National Standard of the People’s Republic of China
    National Standard of the People’s Republic of China 2005Target Text Quality Requirements for Translation Services. Beijing: Standards Press of China.
    [Google Scholar]
  19. Perego, Elisa
    2012Eye Tracking in Audiovisual Translation. Roma: Aracne.
    [Google Scholar]
  20. Rayner, Keith
    1998 “Eye Movements in Reading and Information Processing: 20 Years of Research.” Psychological Bulletin124 (3): 372–422. doi:10.1037/0033‑2909.124.3.372
    https://doi.org/10.1037/0033-2909.124.3.372 [Google Scholar]
  21. Rayner, Keith , and Alexander Pollatsek
    1989The Psychology of Reading. Englewood Cliffs, NJ: Prentice Hall.
    [Google Scholar]
  22. Sperber, Dan , and Deirdre Wilson
    1995Relevance: Communication and Cognition. 2nd ed.Oxford: Blackwell.
    [Google Scholar]
  23. Szarkowska, Agnieszka and Jan-Louis Kruger
    2015 “Subtitles on the Moving Image: An Overview of Eye Tracking Studies.” Refractory: a Journal of Entertainment Media, 25. Accessed11 Nov 2017: refractory.unimelb.edu.au/2015/02/07/kruger-szarkowska-krejtz/
    [Google Scholar]
  24. Tannen, Deborah
    1989Talking Voices: Repetition, Dialogue and Imagery in Conversational Discourse. Cambridge: Cambridge University Press.
    [Google Scholar]
  25. Thomas, Jenny
    1995Meaning in Interaction: An Introduction to Pragmatics. London: Longman.
    [Google Scholar]
  26. Wilson, Deirdre , and Dan Sperber
    2002 “Relevance Theory.” UCL Working papers in Linguistics14: 249–287.
    [Google Scholar]
  27. Yus Ramos, Francisco B.
    2008 “Alterations of Relevance in Cyber—Media.” Universitas Psychologica7 (3): 629–642.
    [Google Scholar]
  28. Zheng, Binghan , and Xia Xiang
    2014 “The Impact of Cultural Background Knowledge in the Processing of Metaphorical Expressions.” Translation and Interpreting Studies9 (1): 5–24. doi:10.1075/tis.9.1.01zhe
    https://doi.org/10.1075/tis.9.1.01zhe [Google Scholar]

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Explanatory Caption; eyetracking; reception; Relevance Theory; retrospection
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error