Volume 11, Issue 1
  • ISSN 2211-3711
  • E-ISSN: 2211-372X
Buy:$35.00 + Taxes



Empirical research on cognitive processing in AVT has been on the rise in recent years. A number of overarching works have recommended more standardised approaches and methodological frameworks to contribute to more streamlined, replicable, reproducible and valid future AVT research. To date, the issue of comparability of research materials (e.g., clips, subtitle tracks, comprehension questionnaires) and, more specifically, how to achieve comparability in quasi-experimental and experimental studies, particularly those involving repeated measures, has received little attention. This paper aims to address this knowledge gap by proposing a common-sense ten-step preparatory process for quasi-experimental and experimental subtitling studies. This preparatory process has previously been used in the S4AE project. The paper will focus on the final four steps, consisting of the preparation and comparison of multiple subtitle tracks. These steps were conceptualized taking into account the present research on subtitle parameters and the obstacles encountered while preparing comparable subtitle tracks.


Article metrics loading...

Loading full text...

Full text loading...


  1. Brysbaert, Marc, and Boris New
    2009 “Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English.” Behavior Rsearch Methods41(4): 977–990. 10.3758/BRM.41.4.977
    https://doi.org/10.3758/BRM.41.4.977 [Google Scholar]
  2. Clifton, Charles, Adrian Staub, and Keith Rayner
    2007 “Eye movements in reading words and sentences.” InEye movements: A window on mind and brain, edited byRoger P. G. Van Gompel, Martin H. Fischer, Wayne S. Murray, and Robin L. Hill, 341–371. Amsterdam: Elsevier. 10.1016/B978‑008044980‑7/50017‑3
    https://doi.org/10.1016/B978-008044980-7/50017-3 [Google Scholar]
  3. Díaz Cintas, Jorge
    2003Teoría y práctica de la subtitulación: Inglés-Español. Barcelona: Ariel.
    [Google Scholar]
  4. 2020 “Audiovisual translation.” InThe Bloomsbury Companion to Language Industry Studies, edited byErik Angelone, Maureen Ehrensberger-Dow, and Gary Massey, 209–230. London: Bloomsbury. 10.5040/9781350024960.0014
    https://doi.org/10.5040/9781350024960.0014 [Google Scholar]
  5. Díaz Cintas, Jorge, and Aline Remael
    2014Audiovisual Translation: Subtitling. Manchester: St Jerome. 10.4324/9781315759678
    https://doi.org/10.4324/9781315759678 [Google Scholar]
  6. Doherty, Stephen, and Jan-Louis Kruger
    2018 “The development of eye tracking in empirical research on subtitling and captioning.” InSeeing into screens: Eye tracking and the moving image, edited byTessa Dwyer, Claire Perkins, Sean Redmond, and Jodi Sita, 46–56. London: Bloomsbury. 10.5040/9781501329012.0009
    https://doi.org/10.5040/9781501329012.0009 [Google Scholar]
  7. d’Ydewalle, Géry, and Wim De Bruycker
    2007 “Eye movements of children and adults while reading television subtitles.” European Psychologist12(3): 196–205. 10.1027/1016‑9040.12.3.196
    https://doi.org/10.1027/1016-9040.12.3.196 [Google Scholar]
  8. d’Ydewalle, Géry, Johan Van Rensberger, and Joris Pollet
    1987 “Reading a message when the same message is available auditorily in another language: The case of subtitling.” InEye Movements from Physiology to Cognition, edited byJ. Kevin O’Regan, and Araine Lévy-Schoen, 313–321. Amsterdam: Elsevier. 10.1016/B978‑0‑444‑70113‑8.50047‑3
    https://doi.org/10.1016/B978-0-444-70113-8.50047-3 [Google Scholar]
  9. Fresno, Nazaret, and Katarzyna Sepielak
    2020 “Subtitling speed in Media Accessibility research: Some methodological considerations.” Perspectives. 10.1080/0907676X.2020.1761841
    https://doi.org/10.1080/0907676X.2020.1761841 [Google Scholar]
  10. Gottlieb, Henrik
    2012 “Subtitles: Readable dialogue?” InEye tracking in audiovisual translation, edited byElisa Perego, 37–82. Rome: Aracne.
    [Google Scholar]
  11. Hefer, Esté
    2013 “Reading first and second language subtitles: Sesotho viewers reading in Sesotho and English.” Southern African Linguistics and Applied Language Studies31(3): 359–373. 10.2989/16073614.2013.837610
    https://doi.org/10.2989/16073614.2013.837610 [Google Scholar]
  12. Ivarsson, Jan, and Mary Carroll
    1998Subtitling. Simrishamn: TransEdit.
    [Google Scholar]
  13. Karamitroglou, Fotios
    1998 “A proposed set of subtitling standards in Europe.” Translation Journal2(2).
    [Google Scholar]
  14. Keuleers, Emmanuel, Marc Brysbaert, and Boris New
    2010 “Subtlex-NL: A new measure for Dutch word frequency based on film subtitles.” Behavior Research Methods42(3): 643–650. 10.3758/BRM.42.3.643
    https://doi.org/10.3758/BRM.42.3.643 [Google Scholar]
  15. Kidwell, Paul, Guy Lebanon, and Kevyn Collins-Thompson
    2011 “Statistical estimation of word acquisition with application to readability prediction.” Journal of the American Statistical Association106(493): 21–30. 10.1198/jasa.2010.ap09318
    https://doi.org/10.1198/jasa.2010.ap09318 [Google Scholar]
  16. Kraf, Roger, and Henk Pander
    2009 “Leesbaarheidsonderzoek: Oude problemen, nieuwe kansen [Readability research: Old problems, new opportunities].” Tijdschrift voor Taalbeheersing31(2): 97–123. 10.5117/TVT2009.2.LEES356
    https://doi.org/10.5117/TVT2009.2.LEES356 [Google Scholar]
  17. Kruger, Jan-Louis, and Stephen Doherty
    2016 “Measuring cognitive load in the presence of educational video: Towards a multimodal methodology.” Australasian Journal of Educational Technology32(6): 19–31. 10.14742/ajet.3084
    https://doi.org/10.14742/ajet.3084 [Google Scholar]
  18. Kruger, Jan-Louis, Esté Hefer, and Gordon Matthew
    2014 “Attention distribution and cognitive load in a subtitled academic lecture: L1 vs. L2.” Journal of Eye Movement Research7(5): 1–15. 10.16910/jemr.7.5.4
    https://doi.org/10.16910/jemr.7.5.4 [Google Scholar]
  19. Kruger, Jan-Louis, María T. Soto-Sanfiel, Stephen Doherty, and Ronny Ibrahim
    2016 “Towards a cognitive audiovisual translatology.” InReembedding Translation Process Research, edited byRicardo Muñoz Martín, 171–193. Amsterdam: John Benjamins. 10.1075/btl.128.09kru
    https://doi.org/10.1075/btl.128.09kru [Google Scholar]
  20. Kruger, Jan-Louis, and Faans Steyn
    2014 “Subtitles and eye tracking: Reading and performance.” Reading Research Quarterly49(1): 105–120. 10.1002/rrq.59
    https://doi.org/10.1002/rrq.59 [Google Scholar]
  21. Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz
    2015 “Subtitles on the moving image: An overview of eye tracking studies.” Refractory: A Journal of Entertainment Media251: 1–14.
    [Google Scholar]
  22. Kruger, Jan-Louis, Natalia Wisniewksa, and Sixin Liao
    2022 “Why subtitle speed matters: Evidence from word skipping and rereading.” Applied Psycholinguistics43(1): 211–236. 10.1017/S0142716421000503
    https://doi.org/10.1017/S0142716421000503 [Google Scholar]
  23. Lavaur, Jean-Marc, and Dominique Bairstow
    2011 “Languages on the screen: Is film comprehension related to the viewers’ fluency level and to the language in the subtitles?” International Journal of Psychology46(6): 455–462. 10.1080/00207594.2011.565343
    https://doi.org/10.1080/00207594.2011.565343 [Google Scholar]
  24. Leppink, Jimmie, and Angelique van den Heuvel
    2015 “The evolution of cognitive load theory and its application to medical education.” Perspectives on Medical Education4(3): 119–127. 10.1007/s40037‑015‑0192‑x
    https://doi.org/10.1007/s40037-015-0192-x [Google Scholar]
  25. Liao, Sixin, Lili Yu, Erik D. Reichle, and Jan-Louis Kruger
    2021 “Using eye movements to study the reading of subtitles in video.” Scientific Studies of Reading25(5): 417–435. 10.1080/10888438.2020.1823986
    https://doi.org/10.1080/10888438.2020.1823986 [Google Scholar]
  26. Moran, Siobhan
    2012 “The effect of linguistic variation on subtitle reception.” InEye tracking in audiovisual translation, edited byElisa Perego, 37–82. Rome: Aracne.
    [Google Scholar]
  27. Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
    2018 “Conducting experimental research in audiovisual translation (AVT): A position paper.” The Journal of Specialised Translation301: 105–126.
    [Google Scholar]
  28. Pedersen, Jan
    2017 The FAR model: Assessing quality in interlingual subtitling. The Journal of Specialised Translation281: 210–229.
    [Google Scholar]
  29. Perego, Elisa
    2008 “Subtitles and line-breaks: Towards improved readability.” InBetween Text and Image: Updating research in screen translation, edited byDelia Chiaro, Christine Heiss, and Chiara Bucaria, 211–223. Amsterdam: John Benjamins. 10.1075/btl.78.21per
    https://doi.org/10.1075/btl.78.21per [Google Scholar]
  30. Perego, Elisa, Fabio Del Missier, and Marta Stragà
    2018 Dubbing vs. Subtitling: Complexity matters. Target30(1): 137–157. 10.1075/target.16083.per
    https://doi.org/10.1075/target.16083.per [Google Scholar]
  31. Romero-Fresco, Pablo
    2009 “More haste less speed: Edited versus verbatim respoken subtitles.” Vial-vigo International Journal of Applied Linguistics61: 109–133.
    [Google Scholar]
  32. Schotter, Elizabeth R., and Keith Rayner
    2012 “Eye movements in reading: Implications for reading subtitles.” InEye tracking in audiovisual translation, edited byElisa Perego, 83–104. Rome: Aracne.
    [Google Scholar]
  33. Szarkowska, Agnieszka, and Lidia Bogucka
    2019 “Six-second rule revisited: An eye tracking study on the impact of speech rate and language proficiency on subtitle reading.” Translation, Cognition & Behavior2(1): 101–124. 10.1075/tcb.00022.sza
    https://doi.org/10.1075/tcb.00022.sza [Google Scholar]
  34. Szarkowska, Agnieszka, and Gerber-Morón, Oliva
    2018 “Viewers can keep up with fast subtitles: Evidence from eye movements.” PLoS One13(6). 10.1371/journal.pone.0199331
    https://doi.org/10.1371/journal.pone.0199331 [Google Scholar]
  35. Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Klyszejko, and Anna Wieczorek
    2011 “Verbatim, standard, or edited? Reading patterns of different captioning styles among deaf, hard of hearing and hearing viewers.” American Annals of the Deaf156(4): 363–378. 10.1353/aad.2011.0039
    https://doi.org/10.1353/aad.2011.0039 [Google Scholar]
  36. van Heuven, Walter J. B., Pawel Mandera, Emmanuel Keuleers, and Marc Brysbaert
    2014 “Subtlex-UK: A new and improved word frequency database for British English.” Quarterly Journal of Experimental Psychology67(6): 1176–1190. 10.1080/17470218.2013.850521
    https://doi.org/10.1080/17470218.2013.850521 [Google Scholar]
  37. Van Hoecke, Senne M., Iris Schrijver, and Isabelle S. Robert
    2022 “Methodological preparation of a within-subject audiovisual cognition, reception and perception study.” Journal of Audiovisual Translation, 5(1): 94–128. 10.47476/jat.v5i1.2022.163
    https://doi.org/10.47476/jat.v5i1.2022.163 [Google Scholar]

Data & Media loading...

  • Article Type: Research Article
Keyword(s): audiovisual translation (AVT); cognition; comparability; methodology; subtitling
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error