1887
  1. Home
  2. e-Journals
  3. Translation and Translanguaging in Multilingual Contexts
  4. Volume 9, Issue 2
  5. Article
Volume 9, Issue 2
  • ISSN 2352-1805
  • E-ISSN: 2352-1813
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This paper reports on an eye-tracking study investigating the processing and mnemonic retention of reverse subtitles (foreign-language subtitles presented alongside native-language audio) in learners of Italian as a Foreign language (IFL). 26 English native speakers with a CEFR B2+ Italian level watched an English clip with Italian subtitles in two translation conditions, formal similarity (literal transfer) and formal discrepancy (non-literal transfer). Immediately after watching, they answered recognition and recall questions. This study examines memory, attention allocation and the concept of noticing, which was investigated through triangulation of eye tracking, verbatim recognition and explicit reports. Data analysis methods include generalised mixed-effect modelling. Results revealed that reverse subtitles have acquisitional potential for advanced IFL learners, noticing can be probed experimentally, and formal (dis)similarity appears to have some psychological reality in the mind of the learner, being able to affect both recognition and recall. Evidence of novel word learning as well as deepening of existing knowledge emerged from the analyses, supporting the view that reversed subtitles could be more fruitfully exploited in FLL contexts. The paper presents details of the data analyses, discusses them in relation to Second Language Acquisition (SLA) and psycholinguistic concepts, and draws some recommendations based on the findings.

© 2023 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/ttmc.00111.rag
2023-07-14
2024-12-10

  • From This Site

    /content/journals/10.1075/ttmc.00111.rag
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Ávila-Cabrera, José Javier
    2021 “Reverse Subtitling in the ESP Class to Improve Written Skills in English: A Case Study.” Journal of Audiovisual Translation4 (1): 27–49. 10.47476/jat.v4i1.2021.22
     https://doi.org/10.47476/jat.v4i1.2021.22 [Google Scholar]
  2. Baddeley, Alan
    1986 Working Memory. Oxford: Oxford University Press.
     [Google Scholar]
  3. 2003 “Working Memory and Language: An Overview.” Journal of Communication Disorders36 (3): 189–208. 10.1016/S0021‑9924(03)00019‑4
     https://doi.org/10.1016/S0021-9924(03)00019-4 [Google Scholar]
  4. Baddeley, Alan, and Graham Hitch
    1974 “Working Memory.” InThe Psychology of Learning and Motivation: Advances in Research and Theory, ed. byGordon A. Bower, 47–89. New York: Academic Press.
     [Google Scholar]
  5. Baltova, Iva
    1999 The Effect of Subtitled and Staged Video Input on the Learning and Retention of Content and Vocabulary in a Second Language. PhD diss. University of Toronto.
  6. Bates, Douglas
    2010 Lme4: Mixed-Effects Modeling with R. New York: Springer.
     [Google Scholar]
  7. Bird, Stephen A., and John N. Williams
    2002 “The Effect of Bimodal Input on Implicit and Explicit Memory: An Investigation into the Benefits of Within-language Subtitling.” Applied Psycholinguistics23 (04). 10.1017/S0142716402004022
     https://doi.org/10.1017/S0142716402004022 [Google Scholar]
  8. Bolker, Benjamin M., Mollie E. Brooks, Connie J. Clark, Shane W. Geange, John R. Poulsen, Michael H. Stevens, and Jada-Simone S. White
    2009 “Generalized Linear Mixed Models: A Practical Guide for Ecology and Evolution.” Trends in Ecology and Evolution24 (3): 127–135. 10.1016/j.tree.2008.10.008
     https://doi.org/10.1016/j.tree.2008.10.008 [Google Scholar]
  9. BOS (Bristol Online Survey)
    BOS (Bristol Online Survey) 2016 The Online Survey Tool Designed for Academic Research, Education and Public Sector Organisations. https://www.onlinesurveys.ac.uk/about/
  10. Čepon, Slavica
    2011 “Interlingual Subtitling as a Mode of Facilitating Incidental Foreign Language Acquisition.” English for Specific Purposes World33 (11): 1–37.
     [Google Scholar]
  11. 2013 “Effective Use of the Media: Video in the Foreign Language Classroom.” Medijska Istrazivanja19 (1): 83–104.
     [Google Scholar]
  12. Clifton, Charles, Adrian Staub, and Keith Rayner
    2007 “Eye Movements in Reading Words and Sentences.” InEye Movements: A Window on Mind and Brain, ed. byRoger P. G. Van Gompel, Martin H. Fischer, Wayne S. Murray, and Robin L. Hill, 341–371. Oxford: Elsevier. 10.1016/B978‑008044980‑7/50017‑3
     https://doi.org/10.1016/B978-008044980-7/50017-3 [Google Scholar]
  13. Conklin, Kathy, and Ana Pellicer-Sánchez
    2016 “Using Eye-tracking in Applied Linguistics and Second Language Research.” Second Language Research32 (3): 453–467. 10.1177/0267658316637401
     https://doi.org/10.1177/0267658316637401 [Google Scholar]
  14. Cowan, Nelson, Emily M. Elliott, J. Scott Saults, Candice C. Morey, Sam Mattox, Anna Hismjatullina, and Andrew R. A. Conway
    2005 “On the Capacity of Attention: Its Estimation and its Role in Working Memory and Cognitive Aptitudes.” Cognitive Psychology51 (1): 42–100. 10.1016/j.cogpsych.2004.12.001
     https://doi.org/10.1016/j.cogpsych.2004.12.001 [Google Scholar]
  15. d’Ydewalle, Géry, and Wim De Bruycker
    2007 “Eye Movements of Children and Adults while Reading Television Subtitles.” European Psychologist12 (3): 196–205. 10.1027/1016‑9040.12.3.196
     https://doi.org/10.1027/1016-9040.12.3.196 [Google Scholar]
  16. Danan, Martine
    1992 “Reversed Subtitling and Dual Coding Theory: New Directions for Foreign Language Instruction.” Language Learning421: 497–527. 10.1111/j.1467‑1770.1992.tb01042.x
     https://doi.org/10.1111/j.1467-1770.1992.tb01042.x [Google Scholar]
  17. Daneman, Meredyth, and Patricia A. Carpenter
    1980 “Individual Differences in Working Memory and Reading.” Journal of Verbal Learning and Verbal Behaviour19 (4): 450–466. 10.1016/S0022‑5371(80)90312‑6
     https://doi.org/10.1016/S0022-5371(80)90312-6 [Google Scholar]
  18. Daneman, Meredyth, and Philip M. Merikle
    1996 “Working Memory and Language Comprehension: A Meta-analysis.” Psychonomic Bulletin & Review3 (4): 422–433. 10.3758/BF03214546
     https://doi.org/10.3758/BF03214546 [Google Scholar]
  19. Dixon, Peter
    2008 “Models of Accuracy in Repeated-measures Designs.” Journal of Memory and Language59 (4): 447–456. 10.1016/j.jml.2007.11.004
     https://doi.org/10.1016/j.jml.2007.11.004 [Google Scholar]
  20. Doughty, Catherine
    2001 “Cognitive Underpinnings of Focus on Form.” InCognition and Second Language Instruction, ed. byPeter Robinson, 206–257. Cambridge: Cambridge University Press. 10.1017/CBO9781139524780.010
     https://doi.org/10.1017/CBO9781139524780.010 [Google Scholar]
  21. Farmer, Thomas A., Jennifer B. Misyak, and Morten H. Christiansen
    2012 “Individual Differences in Sentence Processing.” InThe Cambridge Handbook of Psycholinguistics, ed. byMichael Spivey, Ken McRae, and Marc Joanisse, 353–364. New York: Cambridge University Press. 10.1017/CBO9781139029377.018
     https://doi.org/10.1017/CBO9781139029377.018 [Google Scholar]
  22. Gass, Susan M., Paula Winke, Daniel R. Isbell, and Jieun Irene Ahn
    2019 “How Captions Help People Learn Languages: A Working-memory, Eye-tracking Study.” Language Learning & Technology231: 84–104.
     [Google Scholar]
  23. Gathercole, Susan E.
    2007 “Working Memory and Language”. InThe Oxford Handbook of Psycholinguistics, ed. byM. Gareth Gaskell, 757–769. Oxford: Oxford University Press. 10.1093/oxfordhb/9780198568971.013.0046
     https://doi.org/10.1093/oxfordhb/9780198568971.013.0046 [Google Scholar]
  24. Ghia, Elisa
    2007 “A Case Study on the Role of Interlingual Subtitles on the Acquisition of L2 Syntax: Initial Results.” InVoices on Translation. Linguistic, Multimedia, and Cognitive Perspectives, ed. byAnnalisa Baicchi, special issue ofRILA. Rassegna Italiana di Linguistica Applicata49 (1–2): 167–177.
     [Google Scholar]
  25. 2012a Subtitling Matters: New Perspectives on Subtitling and Foreign Language Learning. Bern: Peter Lang.
     [Google Scholar]
  26. 2012b “The Impact of Translation Strategies on Subtitle Reading.” InEye Tracking in Audiovisual Translation, ed. byElisa Perego, 157–182. Rome: Aracne.
     [Google Scholar]
  27. Godfroid, Aline, Alex Housen, and Frank Boers
    2010 “A Procedure for Testing the Noticing Hypothesis in the Context of Vocabulary Acquisition.” InInside the Learner’s Mind: Cognitive Processing and Second Language Acquisition, ed. byMartin Pütz, and Laura Sicola, 169–197. Amsterdam: John Benjamins. 10.1075/celcr.13.14god
     https://doi.org/10.1075/celcr.13.14god [Google Scholar]
  28. Godfroid, Aline, and Bronson Hui
    2020 “Five Common Pitfalls in Eye-tracking Research.” Second Language Research36 (3): 277–305. 10.1177/0267658320921218
     https://doi.org/10.1177/0267658320921218 [Google Scholar]
  29. Gottlieb, Henrik
    1992 “Subtitling: A New University Discipline.” InTeaching Translation and Interpreting: Training Talent and Experience. Papers from the First Language International Conference, Elsinore, Denmark, 1991, ed. byCay Dollerup, and Anne Loddegaard, Amsterdam: John Benjamins161–170. 10.1075/z.56.26got
     https://doi.org/10.1075/z.56.26got [Google Scholar]
  30. Harrington, Michael, and Mark Sawyer
    1992 “L2 Working Memory Capacity and L2 Reading Skill.” Studies in Second Language Acquisition141: 25–38. 10.1017/S0272263100010457
     https://doi.org/10.1017/S0272263100010457 [Google Scholar]
  31. Holobow, Naomi E., Wallace E. Lambert, and Laura Sayegh
    1984 “Pairing Script and Dialogue: Combinations that Show Promise for Second or Foreign Language Learning.” Language Learning341: 59–74. 10.1111/j.1467‑1770.1984.tb00352.x
     https://doi.org/10.1111/j.1467-1770.1984.tb00352.x [Google Scholar]
  32. Kruger, Jan-Louis
    2016 “Psycholinguistics and Audiovisual Translation.” Target28 (2): 276–287. 10.1075/target.28.2.08kru
     https://doi.org/10.1075/target.28.2.08kru [Google Scholar]
  33. Lambert, Wallace E., Inga Boehler, and Nelly Sidoti
    1981 “Choosing the Languages of Subtitles and Spoken Dialogues for Media Presentations: Implications for Second Language Education.” Applied Psycholinguistics2 (02). 10.1017/S0142716400000904
     https://doi.org/10.1017/S0142716400000904 [Google Scholar]
  34. Lambert, Wallace E., and Naomi E. Holobow
    1984 “Combinations of Printed Script and Spoken Dialogue that Show Promise for Students of a Foreign Language.” Canadian Journal of Behavioural Science161: 1–11. 10.1037/h0080775
     https://doi.org/10.1037/h0080775 [Google Scholar]
  35. Lavaur, Jean-Marc, and Dominique Bairstow
    2011 “Languages on the Screen: Is Film Comprehension Related to the Viewers’ Fluency Level and to the Language in the Subtitles?” International Journal of Psychology46 (6): 455–62. 10.1080/00207594.2011.565343
     https://doi.org/10.1080/00207594.2011.565343 [Google Scholar]
  36. Lee, Minjin, and Andrea Révész
    2020 “Promoting Grammatical Development through Captions and Textual Enhancement in Multimodal Input-based Tasks.” Studies in Second Language Acquisition42 (3): 625–651. 10.1017/S0272263120000108
     https://doi.org/10.1017/S0272263120000108 [Google Scholar]
  37. Leow, Ronald P.
    2013 “Attention, Noticing, and Awareness in Second Language Acquisition.” InThe Encyclopedia of Applied Linguistics, ed. byC. A. Chapelle, 269–275. Chichester, West Sussex: Wiley-Blackwell Publishing.
     [Google Scholar]
  38. Leow, Ronald P., and Melissa A. Bowles
    2005 “Attention and Awareness in SLA.” InMind and Context in Adult Second Language Acquisition: Methods, Theory, and Practice, ed. byCristina Sanz, 179–196. Washington, DC: Georgetown University Press.
     [Google Scholar]
  39. Nida, Eugene
    1964 Toward a Science of Translating, with Special Reference Involved in Bible Translating. Leiden: A.J. Brill.
     [Google Scholar]
  40. Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
    2018 “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” The Journal of Specialised Translation (JoSTrans) 301: 105–126.
     [Google Scholar]
  41. Puimège, Eva, Maribel Montero Perez, and Elke Peters
    2021 “Promoting L2 Acquisition of Multiword Units through Textually Enhanced Audiovisual Input: An Eye-tracking Study.” Second Language Research: 1–22. 10.1177/02676583211049741
     https://doi.org/10.1177/02676583211049741 [Google Scholar]
  42. R Development Core Team
    R Development Core Team 2017 R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria. AccessedAugust 8, 2022: www.R-project.org/
     [Google Scholar]
  43. Ragni, Valentina
    2017 More than Meets the Eye. A Reception Study on the Effects of Translation on Noticing and Memorisation of L2 Reverse Subtitles. PhD Diss. University of Leeds.
  44. 2020 “More than Meets the Eye: An Eye-tracking Study of the Effects of Translation on the Processing and Memorisation of Reversed Subtitles.” Journal of Specialised Translation331: 99–128.
     [Google Scholar]
  45. Robinson, Peter
    1995 “Attention, Memory, and the ‘Noticing’ Hypothesis.” Language Learning45 (2): 283–331. 10.1111/j.1467‑1770.1995.tb00441.x
     https://doi.org/10.1111/j.1467-1770.1995.tb00441.x [Google Scholar]
  46. 1996 “Learning Simple and Complex Second Language Rules under Implicit, Incidental, Rule-search, and Instructed Conditions.” Studies in Second Language Acquisition18 (1): 27–67. 10.1017/S0272263100014674
     https://doi.org/10.1017/S0272263100014674 [Google Scholar]
  47. Schmidt, Richard
    1990 “The Role of Consciousness in Second Language Learning.” Applied Linguistics111: 129–158. 10.1093/applin/11.2.129
     https://doi.org/10.1093/applin/11.2.129 [Google Scholar]
  48. 2001 “Attention.” InCognition and Second Language Instruction, ed. byPeter Robinson, 3–32. Cambridge: Cambridge University Press. 10.1017/CBO9781139524780.003
     https://doi.org/10.1017/CBO9781139524780.003 [Google Scholar]
  49. Smith, Brian
    2012 “Eye Tracking as a Measure of Noticing: A Study of Explicit Recasts in SCMC.” Language Learning & Technology16 (3): 53–81.
     [Google Scholar]
  50. Swain, Merrill
    1985 “Communicative Competence: Some Roles of Comprehensible Input & Comprehensible Output in its Development.” InInput in Second Language Acquisition, ed. bySusan M. Gass, and Carolyn Madden, 235–256. New York: Newbury House.
     [Google Scholar]
  51. Szmalec, Arnaud, Marc Brysbaert, and Wouter Duyck
    2013 “Working Memory and (Second) Language Processing.” InMemory, Language, and Bilingualism: Theoretical and Applied Approaches, ed. byJeanette Altarriba, and Ludmila Isurin, 74–94. Cambridge: Cambridge University Press.
     [Google Scholar]
  52. Talaván, Noa, Ana Ibáñez Moreno, and Elena Bárcena
    2017 “Exploring Collaborative Reverse Subtitling for the Enhancement of Written Production Activities in English as a Second Language.” ReCALL11: 1–20. 10.1017/S0958344016000197
     https://doi.org/10.1017/S0958344016000197 [Google Scholar]
  53. Tomlin, Russell S., and Victor Villa
    1994 “Attention in Cognitive Science and Second Language Acquisition.” Studies in Second Language Acquisition16 (2): 183–203. 10.1017/S0272263100012870
     https://doi.org/10.1017/S0272263100012870 [Google Scholar]
  54. Truscott, John
    1998 “Noticing in Second Language Acquisition: A Critical Review.” Second Language Research14 (2): 103–135. 10.1191/026765898674803209
     https://doi.org/10.1191/026765898674803209 [Google Scholar]
  55. Van den Noort, Maurits, Peggy M. P. C. Bosch, Marco Haverkort, and Kenneth Hugdahl
    2008 “A Standard Computerized Version of the Reading Span Test in Different Languages.” European Journal of Psychological Assessment241: 35–42. 10.1027/1015‑5759.24.1.35
     https://doi.org/10.1027/1015-5759.24.1.35 [Google Scholar]
  56. Van Lommel, Sven, Annouschka Laenen, and Géry d’Ydewalle
    2006 “Foreign-Grammar Acquisition While Watching Subtitled Television Programmes.” British Journal of Educational Psychology76 (2): 243–258. 10.1348/000709905X38946
     https://doi.org/10.1348/000709905X38946 [Google Scholar]
  57. Vanderplank, Robert
    1998 “Subtitles, Silent Film to Teletext.” InConcise Encyclopaedia of Pragmatics, ed. byJacob L. Mey, 961–964. Oxford: Elsevier.
     [Google Scholar]
  58. Vulchanova, Mila, Lisa M. G. Aurstad, Ingrid E. N. Kvitnes, and Hendrik Eshuis
    2015 “As Naturalistic as it Gets: Subtitles in the English Classroom in Norway.” Frontiers in Psychology51: 1–10. 10.3389/fpsyg.2014.01510
     https://doi.org/10.3389/fpsyg.2014.01510 [Google Scholar]
  59. Wang, Andi, and Ana Pellicer-Sánchez
    2022 “Incidental Vocabulary Learning from Bilingual Subtitled Viewing: An Eye-tracking Study.” Language Learning72 (3): 765–805. 10.1111/lang.12495
     https://doi.org/10.1111/lang.12495 [Google Scholar]
  60. Winke, Paula, Susan Gass, and Tetyana Sydorenko
    2013 “Factors Influencing the Use of Captions by Foreign Language Learners: An Eye-tracking Study.” The Modern Language Journal97 (1): 254–275. 10.1111/j.1540‑4781.2013.01432.x
     https://doi.org/10.1111/j.1540-4781.2013.01432.x [Google Scholar]
  61. Wood Bowden, Harriet, Cristina Sanz, and Catherine Stafford
    2005 “Individual Differences: Age, Sex, Working Memory, and Prior Knowledge.” InMind and Context in Adult Second Language Acquisition: Methods, Theory and Practice, ed. byCristina Sanz, 105–140. Washington, DC: Georgetown University Press.
     [Google Scholar]
  62. Zarei, Abbas Ali
    2009 “The Effect of Bimodal, Standard, and Reversed Subtitling on L2 Vocabulary Recognition and Recall.” Pazhuhesh-e Zabanha-ye Khareji491: 65–85.
     [Google Scholar]
  63. Wachowski, Andy, and Lana Wachowski
    1999 The Matrix.
     [Google Scholar]
/content/journals/10.1075/ttmc.00111.rag
Loading
Reverse subtitles in foreign language learning
Translation and Translanguaging in Multilingual Contexts 9, 261 (2023); https://doi.org/10.1075/ttmc.00111.rag
/content/journals/10.1075/ttmc.00111.rag
/content/journals/10.1075/ttmc.00111.rag
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): audiovisual translation; eye tracking; memory; noticing; reverse subtitles

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error