Usability tests for personalised subtitles

References

1. AENOR (Asociación Española de Normalización y Certificación)
   AENOR (Asociación Española de Normalización y Certificación) 2012 Subtitulado para personas sordas y personas con discapacidad auditiva [Subtitling for the Deaf and Hard-of-Hearing People]. UNE 153010:2012. Madrid: AENOR.
2. Armstrong, Mike, Andy Brown, Michael Crabb, Chris J. Hughes, Rhianne Jones, and James Sandford
   2015 Understanding the Diverse Needs of Subtitle Users in a Rapidly Evolving Media Landscape. Research & Development White Paper WHP 307. British Broadcasting Corporation. AccessedSeptember 18, 2017. downloads.bbc.co.uk/rd/pubs/whp/whp-pdf-files/WHP307.pdf. 10.1049/ibc.2015.0032
   https://doi.org/10.1049/ibc.2015.0032 [Google Scholar]
3. Arnáiz-Uzquiza, Verónica
   2008 “La Objetividad en el Subtitulado. Justificación de los Parámetros Formales Mediante Eye Tracking.” InULISES y la comunidad sorda: Hacia el desarrollo de tecnologías comunicativas para la igualdad de oportunidades, edited byÁlvaro Pérez-Ugena, and Ricardo Vizcaíno Laorga, 73–85. Madrid: Observatorio de las Realidades Sociales y de la Comunicación.
   [Google Scholar]
4. Baker, Robert G.
   1981 Guidelines for the Subtitling of Television Programmes. A report from Southampton University for Independent Television (UK). Southampton (UK): Southampton University.
   [Google Scholar]
5. Bartoll, Eduard
   2004 “Parameters for the Classification of Subtitles.” InTopics in Audiovisual Translation, edited byPilar Orero, 53–60. Amsterdam: John Benjamins Publishing Company. 10.1075/btl.56.08bar
   https://doi.org/10.1075/btl.56.08bar [Google Scholar]
6. Bartoll, Eduard, and Anjana Martínez-Tejerina
   2010 “The Positioning of Subtitles for the Deaf and Hard of Hearing.” InListening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited byAnna Matamala, and Pilar Orero, 69–86. Bern: Peter Lang.
   [Google Scholar]
7. Bernard, Michael, Chia Hui Liao, and Melissa Mills
   2001 “The Effect of Font Type and Size on the Legibility and Reading Time of Online Text by Older Adults.” InCHI EA ’01 Extended Abstracts on Human Factors in Computer Systems, 175–176. New York: ACM Press. 10.1145/634067.634173
   https://doi.org/10.1145/634067.634173 [Google Scholar]
8. Brooke, John
   1996 “SUS-A quick and dirty usability scale.” InUsability Evaluation in Industry, edited byPatrick W. Jordan, Bruce Thomas, Ian Lyall McClelland, and Bernard A. Weerdmeester, 4–7. London: CRC Press, https://www.crcpress.com/product/isbn/9780748404605
   [Google Scholar]
9. Brown, Andy, Rhianne Jones, and Michael Crabb
   2015 “Dynamic Subtitles: The User Experience.” InTVX 15’ Proceedings of the ACM International Conference on Interactive Experiences for TV and Online Video, 103–112. New York: ACM Press. 10.1145/2745197.2745204
   https://doi.org/10.1145/2745197.2745204 [Google Scholar]
10. Carmichael, Alex
    1999 Style Guide for the Design of Interactive Television Services for Elderly Viewers, Winchester: Independent Television Commission. projects.computing.dundee.ac.uk/UTOPIA/publications/Carmichael%20-%20DesignStyleGuideFinal.pdf
    [Google Scholar]
11. Carroll, Mary, and Jan Ivarsson
    1998 Subtitling. Simrishamn: TransEdit.
    [Google Scholar]
12. Costa-Montenegro, Enrique, Fátima M. García-Doval, Jonathan Juncal-Martínez, and Belén Barragáns-Martínez
    2016 “SubTitleMe, Subtitles in Cinemas in Mobile Devices.” Universal Access in the Information Society15 (3): 461–472. 10.1007/s10209‑015‑0420‑5
    https://doi.org/10.1007/s10209-015-0420-5 [Google Scholar]
13. Crabb, Michael, Rhianne Jones, Michael Armstrong, and Chris J. Hughes
    2015 “Online News Videos: The UX of Subtitle Position.” InASSETS ’15 Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility. New York: ACM Press. 10.1145/2700648.2809866
    https://doi.org/10.1145/2700648.2809866 [Google Scholar]
14. Czaja, Sara J., Neil Charness, Arthur D. Fisk, Christopher Hertzog, Sankaran N. Nair, Wendy A. Rogers, and Joseph Sharit
    2006 “Factors Predicting the Use of Technology: Findings from the Center for Research and Education on Aging and Technology Enhancement (CREATE).” Psychology and Aging21 (2): 333–352. 10.1037/0882‑7974.21.2.333
    https://doi.org/10.1037/0882-7974.21.2.333 [Google Scholar]
15. d’Ydewalle, Géry, and Ingrid Gielen
    1992 “Attention Allocation with Overlapping Sound, Image, and Text.” InEye Movements and Visual Cognition, edited byKeith Rayner, Springer Series in Neuropsychology, 415–527. New York: Springer. 10.1007/978‑1‑4612‑2852‑3_25
    https://doi.org/10.1007/978-1-4612-2852-3_25 [Google Scholar]
16. d’Ydewalle, Géry, Caroline Praet, Karl Verfaillie, and Johan Van Rensbergen
    1991 “Watching Subtitled Television. Automatic Reading Behaviour.” Communication Research18 (5): 650–666. 10.1177/009365091018005005
    https://doi.org/10.1177/009365091018005005 [Google Scholar]
17. d’Ydewalle, Géry, Johan Van Rensbergen, and Joris Pollet
    1987 “Reading a Message when the Same Message is Available Auditorily in Another Language: The Case of Subtitling.” InEye Movements From Physiology to Cognition: Selected/Edited Proceedings of the Third European Conference on Eye Movements, Dourdan, France, September 1985, edited byJ. K. O’Regan, and A. Levy-Schoen, 313–321. Amsterdam: Elsevier Science Publishers. 10.1016/B978‑0‑444‑70113‑8.50047‑3
    https://doi.org/10.1016/B978-0-444-70113-8.50047-3 [Google Scholar]
18. De Bruycker, Wim, and Géry d’Ydewalle
    2003 “Chapter 31. Reading Native and Foreign Language Television Subtitles in Children and Adults.” InThe Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research, edited byJukka Hyöna, Ralph Radach, and H. Deubel, 671–684. Amsterdam: Elsevier Science BV. 10.1016/B978‑044451020‑4/50036‑0
    https://doi.org/10.1016/B978-044451020-4/50036-0 [Google Scholar]
19. de Linde, Zoé, and Neil Kay
    1999 The Semiotics of Subtitling. Manchester: St. Jerome Publishing.
    [Google Scholar]
20. DTV4All (Digital Television for All)
    DTV4All (Digital Television for All) 2010 European Research Project. www.psp-dtv4all.org/
21. Dykstra, Dean Julian
    1993 A Comparison of Heuristic Evaluation and Usability Testing: The Efficacy of a Domain-specific Heuristic Checklist. Texas: A&M University.
    [Google Scholar]
22. Gottlieb, Henrik
    1998 “Subtitles, Translation and Idioms.” PhD Thesis, University of Copenhagen.
23. Gottlieb, Henrik
    2005 “Multidimensional Translation: Semantics turned Semiotics.” InMuTra 2005: Challenges of Multidimensional Translation: Conference Proceedings, edited bySandra Nauert, and Heidrun Gerzymisch-Arbogast, EU-High-Level Scientific Conference Series, 33–61, www.euroconferences.info/proceedings/2005_Proceedings/2005_Gottlieb_Henrik.pdf
    [Google Scholar]
24. Greco, Gian Maria
    2016 “On Accessibility as a Human Right, with an application to Media Accessibility.” InResearching Audio Description, edited byAnna Matamala, and Pilar Orero, Palgrave Studies in Translating and Interpreting Series, 11–13. London: Palgrave Macmillan. 10.1057/978‑1‑137‑56917‑2_2
    https://doi.org/10.1057/978-1-137-56917-2_2 [Google Scholar]
25. Gulliver, Stephen, and Ghinea, George
    2003 “How Level and Type of Deafness Affect User Perception of Multimedia Video Clips.” Universal Access in the Information Society2 (4): 374–386. 10.1007/s10209‑003‑0067‑5
    https://doi.org/10.1007/s10209-003-0067-5 [Google Scholar]
26. HBB4ALL (Hybrid Broadcast Broadband For ALL)
    HBB4ALL (Hybrid Broadcast Broadband For ALL) 2017 European Research Project. pagines.uab.cat/hbb4all/
27. Holken, Hamut, and Pilar Orero
    2014 “TV Content Delivery to PC, Tablet, Smartphone: From the Accessibility Vision into Market Reality.” ThinkMind Mobility 2014: The Fourth International Conference on Mobile Services, Resources, and Users, 99–104, www.thinkmind.org/index.php?view=article&articleid=mobility_2014_4_50_70009
    [Google Scholar]
28. Hughes, Chris J., Mike Armstrong, Rhianne Jones, and Michael Crabb
    2015 “Responsive Design for Personalised Subtitles.” InW4A ’15 Proceedings of the 12th Web for All Conference, 8. New York: ACM Press. 10.1145/2745555.2746650
    https://doi.org/10.1145/2745555.2746650 [Google Scholar]
29. ISO (International Organization for Standardization)
    ISO (International Organization for Standardization) 2017 Information Technology – User Interface Component Accessibility – Part 23: Guidance on the Visual Presentation of Audio Information (including Captions and Subtitles). ISO/IEC 20071-23. Paris: ISO.
30. Karamitroglou, Fotios
    1997 “A Proposed Set of Subtitling Standards in Europe.” Translation Journal2 (2), translationjournal.net/journal/04stndrd.htm
    [Google Scholar]
31. Kirkland, C. Eric
    1999 “Evaluation of Captioning Features to Inform Development of Digital Television Captioning Capabilities.” American Annals of the Deaf144 (3): 250–260. 10.1353/aad.2012.0140
    https://doi.org/10.1353/aad.2012.0140 [Google Scholar]
32. Koolstra, Cees M., and Jonannes W. J. Beentjes
    1999 “Children’s vocabulary acquisition in a foreign language through watching subtitled television programs at home.” Education Technology Research and Development47 (1): 51–60. 10.1007/BF02299476
    https://doi.org/10.1007/BF02299476 [Google Scholar]
33. Koolstra, Cees M., Tom H. A. van der Voort, and Leo J. Th. van der Kamp
    1997 “Television’s Impact on Children’s Reading Comprehension and Decoding Skills: A 3-Year Panel Study.” Reading Research Quarterly32 (2): 128–152. 10.1598/RRQ.32.2.1
    https://doi.org/10.1598/RRQ.32.2.1 [Google Scholar]
34. Kruger, Jan-Louis, Agnieszka Szarkowska, and Izabela Krejtz
    2015 “Subtitles on the Moving Image: An Overview of Eye Tracking Studies.” Refractory: A Journal of Entertainment Media25: 1–14.
    [Google Scholar]
35. Montagud, Mario, Fernando Boronat, Juan González, and Javier Pastor
    2017 “Web-Based Platform for Subtitles Customization and Synchronization in Multi-Screen Scenarios.” InTVX ’17 Adjunct Publication of the 2017 ACM International Conference on Interactive Experiences for TV and Online Video, 81–82. New York: ACM Press. 10.1145/3084289.3089913
    https://doi.org/10.1145/3084289.3089913 [Google Scholar]
36. Nathan, John G., Daniel R. Anderson, and Diane E. Field
    1984 “Television Viewing at Home: Distances and Visual Angles Adopted by Children and Adults.” InProceedings of the Human Factors and Ergonomics Society Annual Meeting28 (11): 978–982. 10.1177/154193128402801109
    https://doi.org/10.1177/154193128402801109 [Google Scholar]
37. Nettelbeck, Ted, and Nicholas R. Burns
    2010 “Processing Speed, Working Memory and Reasoning Ability from Childhood to Old Age.” Personality and Individual Differences48 (4): 379–384. 10.1016/j.paid.2009.10.032
    https://doi.org/10.1016/j.paid.2009.10.032 [Google Scholar]
38. Neves, Josélia
    2007 “‘There is Research and Research’: Subtitling for the Deaf and Hard of Hearing (SDH).” InTraducción y Accesibilidad. Subtitulación para Sordos y Audiodescripción para Ciegos. Nuevas Modalidades de Traducción Audiovisual, edited byCatalina Jiménez Hurtado, Studien zur romanischen Sprachwissenschaft und interkulturellen Kommunikation Series, 27–40. Frankfurt am Main: Peter Lang.
    [Google Scholar]
39. Nielsen, Jakob, and Rolf Molich
    1990 “Heuristic Evaluation of User Interfaces.” InCHI ’90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 249–256. New York: ACM Press. 10.1145/97243.97281
    https://doi.org/10.1145/97243.97281 [Google Scholar]
40. Noland, Katy C., and Louise H. Truong
    2015 A Survey of UK Television Viewing Conditions. BBC R&D White Paper WHP 287. British Broadcasting Corporation. downloads.bbc.co.uk/rd/pubs/whp/whp-pdf-files/WHP287.pdf
    [Google Scholar]
41. Orero, Pilar, John Birch, and Andrew Lambourne
    2014 “Media accessibility in HBBTV: Interaction for All.” IET Conference Proceedings, 11–15Sept. 2014  10.1049/ib.2014.0022
    https://doi.org/10.1049/ib.2014.0022 [Google Scholar]
42. Orero, Pilar, Stephen Doherty, Jan-Louis Kruger, Anna Matamala, Jan Pedersen, Elisa Perego, Pablo Romero-Fresco, Sara Rovira-Esteva, Olga Soler-Vilageliu, and Agnieszka Szarkowska
    2018 “Conducting Experimental Research in Audiovisual Translation (AVT): A Position Paper.” JosTrans: The Journal of Specialised Translation30: 105–126, www.jostrans.org/issue30/art_orero_et_al.pdf
    [Google Scholar]
43. Orero, Pilar, Javier Serrano, Olga Soler, Anna Matamala, Judit Castella, Maria Teresa Soto Sanfiel, Anna Vilaró, and Carme Mangiron
    2014 “Accessibility to Digital Society: Interaction for All.” ICDS 2014. The Eighth International Conference on Digital Society, 188–191. www.thinkmind.org/index.php?view=article&articleid=icds_2014_8_10_10031
    [Google Scholar]
44. Orero, Pilar, and Irene Tor-Carroggio
    2018 “User Requirements when Designing Learning e-Content: Interaction for All.” InDesigning for the User Experience in Learning Systems, edited byEvangelos Kapros, and Maria Koutsombogera. Berlin: Springer. 10.1007/978‑3‑319‑94794‑5_6
    https://doi.org/10.1007/978-3-319-94794-5_6 [Google Scholar]
45. Perego, Elisa, Fabio Del Missier, Marco Porta, and Mauro Mosconi
    2010 “The Cognitive Effectiveness of Subtitle Processing.” Media Psychology13 (3): 243–272. 10.1080/15213269.2010.502873
    https://doi.org/10.1080/15213269.2010.502873 [Google Scholar]
46. Rayner, Keith
    1998 “Eye Movements in Reading and Information Processing: Twenty Years of Research.” Psychological Bulletin124: 372–422. 10.1037//0033‑2909.124.3.372
    https://doi.org/10.1037//0033-2909.124.3.372 [Google Scholar]
47. Reder, Stephen, and John Bynner
    (eds) 2009 Tracking Adult Literacy and Numeracy Skills: Findings from Longitudinal Research. New York and London: Routledge.
    [Google Scholar]
48. Reuter-Lorenz, Patricia A., and Denise C. Park
    2014 “How Does it STAC Up? Revisiting the Scaffolding Theory of Aging and Cognition.” Neuropsychology Review24 (3): 355–370. 10.1007/s11065‑014‑9270‑9
    https://doi.org/10.1007/s11065-014-9270-9 [Google Scholar]
49. Robson, Gary D.
    2004 The Closed Captioning Handbook. Amsterdam and London: Focal Press. 10.4324/9780080575162
    https://doi.org/10.4324/9780080575162 [Google Scholar]
50. Romero-Fresco, Pablo
    2009 “More Haste Less Speed: Edited versus Verbatim Respoken Subtitles.” VIAL: Vigo International Journal of Applied Linguistics6: 109–133, vialjournal.webs.uvigo.es/pdf/Vial-2009-Article6.pdf
    [Google Scholar]
51. Romero-Fresco, Pablo
    2011 Subtitling through Speech Recognition: Respeaking. Manchester: Routledge.
    [Google Scholar]
52. Rudd, Rima E.
    2007 “Health Literacy Skills of U.S. Adults.” American Journal of Health Behavior31 (Suppl 1): S8–S18. 10.5555/ajhb.2007.31.supp.S8
    https://doi.org/10.5555/ajhb.2007.31.supp.S8 [Google Scholar]
53. Sauro, Jeff
    2011 “Measuring Usability with the System Usability Scale (SUS).” InMeasuring U. https://measuringu.com/sus/
    [Google Scholar]
54. Sauro, Jeff, and James R. Lewis
    2016 “Chapter 8. Standardized Usability Questionnaires.” InQuantifying the User Experience, edited byJeff Sauro and James R. Lewis, 185–240. Amsterdam: Elsevier. 10.1016/B978‑0‑12‑384968‑7.00008‑4
    https://doi.org/10.1016/B978-0-12-384968-7.00008-4 [Google Scholar]
55. Sears, Andrew, and Vicki Hanson
    2011 “Representing Users in Accessibility Research.” InCHI ’11 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2235–2238. New York: ACM Press. 10.1145/1978942.1979268
    https://doi.org/10.1145/1978942.1979268 [Google Scholar]
56. Sinclair II Robert, E., Gilma Annuska Perkins, Michael Edward Dulac Winser, Ramkumar Subramanian, and Paul Reid
    2009 Personalization of User Accessibility Options. U.S. Patent No. US7554522B2, https://patents.google.com/patent/US7554522B2/en
    [Google Scholar]
57. Springett, Mark, Mark Rice, and Richard Griffiths
    2011 “Towards Inclusive Digital Television.” Universal Access in the Information Society12: 1–3. 10.1007/s10209‑011‑0261‑9
    https://doi.org/10.1007/s10209-011-0261-9 [Google Scholar]
58. Szarkowska, Agnieszka, Izabela Krejtz, Zuzanna Kłyszejko, and Anna Wieczorek
    2011 “Verbatim, Standard, or Edited? Reading Patterns of Different Captioning Styles among Deaf, Hard of Hearing, and Hearing Viewers.” American Annals of the Deaf156 (4): 363–378. 10.1353/aad.2011.0039
    https://doi.org/10.1353/aad.2011.0039 [Google Scholar]
59. Szarkowska, Agnieszka, Izabela Krejtz, Olga Pilipczuk, Łukasz Dutka, and Jan-Louis Kruger
    2016 “The Effects of Text Editing and Subtitle Presentation Rate on the Comprehension and Reading Patterns of Interlingual and Intralingual Subtitles among Deaf, Hard of Hearing and Hearing Viewers.” Across Languages and Cultures17 (2): 183–204. 10.1556/084.2016.17.2.3
    https://doi.org/10.1556/084.2016.17.2.3 [Google Scholar]
60. Utray, Francisco, Ana Maria Pereira, and Pilar Orero
    2009 “The Present and Future of Audio Description and Subtitling for the Deaf and Hard of Hearing in Spain.” Meta54 (2): 248–263. 10.7202/037679ar
    https://doi.org/10.7202/037679ar [Google Scholar]
61. Utray, Francisco, Belén Ruiz, and José Antonio Moreiro
    2010 “Maximum Font Size for Subtitles in Standard Definition Digital Television: Tests for a Font Magnifying Application.” InListening to Subtitles: Subtitles for the Deaf and Hard of Hearing, edited byAnna Matamala, and Pilar Orero, 59–68. Bern: Peter Lang.
    [Google Scholar]