1887
image of Investigating cognitive and interpersonal factors in hybrid human-AI practices

Abstract

Abstract

This article investigates interlingual respeaking (IRSP) as a hybrid practice involving direct interaction between a language professional and speech recognition software to produce live subtitles. This technique combines language transfer with the diamesic shift of subtitling, the immediacy factor of interpreting, and direct interaction with AI-driven technology. It is, therefore, a prime example of Multilectal Mediated Communication which requires language professionals to adapt the procedural skills acquired through training and professional experience in related fields. The article reports on an empirical study that explores cognitive abilities and interpersonal traits as underexamined but critical elements of competence in IRSP, guided by Hambrick et al.’s (2018) multifactorial model of expertise. A mixed-methods exploratory design was used to investigate factors influencing IRSP performance. Fifty-one language professionals participated in a twenty-five-hour upskilling course, completing pre- and post-experiment surveys as well as a battery of cognitive tasks and interpersonal skills scales. Multiple regression analyses were used to investigate predictors of IRSP accuracy and errors. Our study found that, among cognitive variables, complex working memory predicts accuracy. Additionally, different working memory resources were found to be involved in different error categories. In relation to interpersonal traits, integrated regulation (a measure of motivation) and conscientiousness were found to negatively predict accuracy. The study highlights the interplay between human cognitive and interpersonal variables in IRSP as a complex form of human-AI interaction, establishing a baseline for future research and advancing methodological approaches and training frameworks for language professionals working in AI-assisted environments.

Available under the CC BY 4.0 license.
Loading

Article metrics loading...

/content/journals/10.1075/target.00035.dav
2025-06-02
2025-06-24
Loading full text...

Full text loading...

/deliver/fulltext/10.1075/target.00035.dav/target.00035.dav.html?itemId=/content/journals/10.1075/target.00035.dav&mimeType=html&fmt=ahah

References

  1. Ackerman, Phillip L.
    2014 “Facts Are Stubborn Things.” Intelligence (): –. 10.1016/j.intell.2014.01.002
    https://doi.org/10.1016/j.intell.2014.01.002 [Google Scholar]
  2. Baddeley, Alan D., and Graham J. Hitch
    1974 “Working Memory.” InThe Psychology of Learning and Motivation, edited byGordon H. Bower, Volume, –. 10.1016/S0079‑7421(08)60452‑1
    https://doi.org/10.1016/S0079-7421(08)60452-1 [Google Scholar]
  3. Barad, Karen
    2007Meeting the Universe Halfway: Quantum Physics and the Entanglement of Matter and Meaning. Durham: Duke University Press. 10.2307/j.ctv12101zq
    https://doi.org/10.2307/j.ctv12101zq [Google Scholar]
  4. Beilock, Sian
    2011Choke — The Secret to Performing Under Pressure. London: Constable.
    [Google Scholar]
  5. Bernardini, Silvia, Pierrette Bouillon, Dragos Ciobanu, Josef van Genabith, Silvia Hansen-Schirra, Sharon O’Brien, Erich Steiner, and Elke Teich
    2019 “Language Service Provision in the 21st Century: Challenges, Opportunities and Educational Perspectives for Translation Studies.” InBologna Process Beyond 2020: Fundamental Values of the EHEA, edited bySijbolt Noorda, Peter Scott, and Martina Vukasovic, –. Bologna: Bologna University Press.
    [Google Scholar]
  6. Bontempo, Karen, and Jemina Napier
    2011 “Evaluating Emotional Stability as a Predictor of Interpreter Competence and Aptitude for Interpreting.” Interpreting (): –. 10.1075/intp.13.1.06bon
    https://doi.org/10.1075/intp.13.1.06bon [Google Scholar]
  7. Bontempo, Karen, Jemina Napier, Laurence Hayes, and Vicki Brashear
    2014 “Does Personality Matter? An International Study of Sign Language Interpreter Disposition.” The International Journal of Translation and Interpreting Research (): –. 10.12807/ti.106201.2014.a02
    https://doi.org/10.12807/ti.106201.2014.a02 [Google Scholar]
  8. Coleman, Geoff, Adrian Furnham, and Luke Treglown
    2023 “Exploring the Dark Side of Conscientiousness. The Relationship Between Conscientiousness and Its Potential Derailers: Perfectionism and Narcissism.” Current Psychology (): –. 10.1007/s12144‑022‑03828‑y
    https://doi.org/10.1007/s12144-022-03828-y [Google Scholar]
  9. Conway, Andrew R. A., Michael J. Kane, Michael F. Bunting, D. Zach Hambrick, Oliver Wilhelm, and Randall W. Engle
    2005 “Working Memory Span Tasks: A Methodological Review and User’s Guide.” Psychonomic Bulletin & Review (): –. 10.3758/BF03196772
    https://doi.org/10.3758/BF03196772 [Google Scholar]
  10. Davitti, Elena
    2025 “Technology for Hybrid Modalities.” InThe Routledge Handbook of Interpreting, Technology and AI, edited byElena Davitti, Tomasz Korybski, and Sabine Braun, –. London: Routledge. 10.4324/9781003053248‑15
    https://doi.org/10.4324/9781003053248-15 [Google Scholar]
  11. Davitti, Elena, Tomasz Korybski, Constantin Orăsan, and Sabine Braun
    2025 “Quality-Related Aspects.” InThe Routledge Handbook of Interpreting, Technology and AI, edited byElena Davitti, Tomasz Korybski, and Sabine Braun, –. London: Routledge. 10.4324/9781003053248‑23
    https://doi.org/10.4324/9781003053248-23 [Google Scholar]
  12. Davitti, Elena, and Annalisa Sandrelli
    2020 “Embracing the Complexity: A Pilot Study on Interlingual Respeaking.” Journal of Audiovisual Translation (): –. 10.47476/jat.v3i2.2020.135
    https://doi.org/10.47476/jat.v3i2.2020.135 [Google Scholar]
  13. Davitti, Elena, Annalisa Sandrelli, Yuan Zou, Tomasz Korybski, and Anna-Stiina Wallinheimo
    . Under review. “Designing a Research-Informed Upskilling Course in Interlingual Respeaking for Language Professionals.”
    [Google Scholar]
  14. Davitti, Elena, and Anna-Stiina Wallinheimo
    2024 Shaping Multilingual Access through Respeaking Technology, Project Data, 2021. UK Data Service. SN: 856687. 10.5255/UKDA‑SN‑856687
    https://doi.org/10.5255/UKDA-SN-856687 [Google Scholar]
  15. Dawson, Hayley
    2019 “Feasibility, Quality and Assessment of Interlingual Live Subtitling.” Journal of Audiovisual Translation (): –. 10.47476/jat.v2i2.72
    https://doi.org/10.47476/jat.v2i2.72 [Google Scholar]
  16. 2020 “A Research-Informed Training Course for Interlingual Respeaking.” Journal of Audiovisual Translation (): –. 10.47476/jat.v3i2.2020.126
    https://doi.org/10.47476/jat.v3i2.2020.126 [Google Scholar]
  17. Dawson, Hayley, and Pablo Romero-Fresco
    2021 “Towards Research-Informed Training in Interlingual Respeaking: An Empirical Approach.” The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2021.1880261
    https://doi.org/10.1080/1750399X.2021.1880261 [Google Scholar]
  18. Deci, Edward L., and Richard M. Ryan
    1985Intrinsic Motivation and Self-Determination in Human Behavior. New York: Plenum. 10.1007/978‑1‑4899‑2271‑7
    https://doi.org/10.1007/978-1-4899-2271-7 [Google Scholar]
  19. Ellis, Lee, Anthony Hoskin, and Malini Ratnasingam
    2018Handbook of Social Status Correlates. Amsterdam: Elsevier.
    [Google Scholar]
  20. Ericsson, K. Anders, Ralf T. Krampe, and Clemens Tesch-Römer
    1993 “The Role of Deliberate Practice in the Acquisition of Expert Performance.” Psychological Review (): –. 10.1037/0033‑295X.100.3.363
    https://doi.org/10.1037/0033-295X.100.3.363 [Google Scholar]
  21. Fabri, Lukas, Björn Häckel, Anna Maria Oberländer, Marius Rieg, and Alexander Stohr
    2023 “Disentangling Human-AI Hybrids.” Business & Information Systems Engineering: –. 10.1007/s12599‑023‑00810‑1
    https://doi.org/10.1007/s12599-023-00810-1 [Google Scholar]
  22. Gile, Daniel
    2015 “Effort Models.” InRoutledge Encyclopedia of Interpreting Studies, edited byFranz Pöchhacker, –. London: Routledge.
    [Google Scholar]
  23. 2023 “The Effort Models and Gravitational Model: Clarifications and Update.” 10.13140/RG.2.2.20178.43209
    https://doi.org/10.13140/RG.2.2.20178.43209 [Google Scholar]
  24. Hambrick, David Z., Brooke N. Macnamara, Guillermo Campitelli, Fredrik Ullén, Miriam A. Mosing
    2016 “Beyond Born Versus Made: A New Look at Expertise.” Psychology of Learning and Motivation: –. 10.1016/bs.plm.2015.09.001
    https://doi.org/10.1016/bs.plm.2015.09.001 [Google Scholar]
  25. Hambrick, David Z., Alexander P. Burgoyne, Brooke N. Macnamara, and Fredrik Ullén
    2018 “Towards a Multifactorial Model of Expertise: Beyond Born Versus Made.” Annals of the New York Academy of Sciences (): –. 10.1111/nyas.13586
    https://doi.org/10.1111/nyas.13586 [Google Scholar]
  26. Hart, Sandra G., and Lowell E. Staveland
    1988 “Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research.” Advances in Psychology: –. 10.1016/S0166‑4115(08)62386‑9
    https://doi.org/10.1016/S0166-4115(08)62386-9 [Google Scholar]
  27. Henderson, John A.
    1980 “Siblings Observed.” Babel (): –. 10.1075/babel.26.4.15hen
    https://doi.org/10.1075/babel.26.4.15hen [Google Scholar]
  28. Hiltunen, Sinikka, Heli Mäntyranta, and Ilmari Määttänen
    2019 “Cooperativeness — A Necessary Trait for Interpreters? A Study on Temperament and Character Dimensions of Experts in Different Fields.” International Journal of Bilingualism (): –. 10.1177/1367006918790808
    https://doi.org/10.1177/1367006918790808 [Google Scholar]
  29. Howard, Joshua L., Julien S. Bureau, Frédéric Guay, Jane X. Y. Chong, and Richard M. Ryan
    2021 “Student Motivation and Associated Outcomes: A Meta-Analysis From Self-Determination Theory.” Perspectives on Psychological Science (): –. 10.1177/1745691620966789
    https://doi.org/10.1177/1745691620966789 [Google Scholar]
  30. Judge, Timothy A., and Joyce E. Bono
    2001 “Relationship of Core Self-evaluations Traits — Self-esteem, Generalized Self-efficacy, Locus of Control, and Emotional Stability — with Job Satisfaction and Job Performance: A Meta-analysis.” Journal of Applied Psychology (): –. 10.1037/0021‑9010.86.1.80
    https://doi.org/10.1037/0021-9010.86.1.80 [Google Scholar]
  31. Korybski, Tomasz, and Elena Davitti
    2024 “Human Agency in Live Subtitling Through Respeaking: Towards a Taxonomy of Effective Editing.” Journal of Audiovisual Translation (): –. 10.47476/jat.v7i2.2024.302
    https://doi.org/10.47476/jat.v7i2.2024.302 [Google Scholar]
  32. Mattes, André, Markus Mück, and Jutta Stahl
    2022 “Perfectionism-related Variations in Error Processing in a Task with Increased Response Selection Complexity.” Personality Neuroscience: . 10.1017/pen.2022.3
    https://doi.org/10.1017/pen.2022.3 [Google Scholar]
  33. Miyake, Akira, Naomi P. Friedman, Michael J. Emerson, Alexander H. Witzki, Amy Howerter, and Tor D. Wager
    2000 “The Unity and Diversity of Executive Functions and Their Contributions to Complex ‘Frontal Lobe’ Tasks: A Latent Variable Analysis.” Cognitive Psychology (): –. 10.1006/cogp.1999.0734
    https://doi.org/10.1006/cogp.1999.0734 [Google Scholar]
  34. Morales, Julia, Francisca Padilla, Carlos J. Gómez-Ariza, and M. Teresa Bajo
    2015 “Simultaneous Interpretation Selectively Influences Working Memory and Attentional Networks.” Acta Psychologica: –. 10.1016/j.actpsy.2014.12.004
    https://doi.org/10.1016/j.actpsy.2014.12.004 [Google Scholar]
  35. O’Neill, Thomas, Nathan McNeese, Amy Heather Barron, and Beau G. Schelble
    2022 “Human–Autonomy Teaming: A Review and Analysis of the Empirical Literature.” Human Factors: The Journal of the Human Factors and Ergonomics Society (): –. 10.1177/0018720820960865
    https://doi.org/10.1177/0018720820960865 [Google Scholar]
  36. Pacailler, Matthew, Sarah Yahoodik, Tetsuya Sato, Jeremiah G. Ammons, and Jeremiah Still
    2022 “Human-Centered Artificial Intelligence: Beyond a Two-Dimensional Framework.” InLecture Notes in Computer Science, edited byJessie Y. C. Chen, Gino Fragomeni, Helmut Degen, and Stavruola Ntoa, –. Springer.
    [Google Scholar]
  37. Pöchhacker, Franz, and Aline Remael
    2019 “New Efforts? A Competence-Oriented Task Analysis of Interlingual Live Subtitling.” Linguistica Antverpiensia: –. 10.52034/lanstts.v18i0.515
    https://doi.org/10.52034/lanstts.v18i0.515 [Google Scholar]
  38. Rai, Arun, Panos Constantinides, and Saonee Sarker
    2019 “Next Generation Digital Platforms: Toward Human-AI Hybrids.” MIS Quarterly (): –.
    [Google Scholar]
  39. Romero-Fresco, Pablo, and Franz Pöchhacker
    2017 “Quality Assessment in Interlingual Live Subtitling: The NTR Model.” Linguistica Antverpiensia: –.
    [Google Scholar]
  40. Rosiers, Alexandra, and June Eyckmans
    2017 “Birds of a Feather? A Comparison of the Personality Profiles of Aspiring Interpreters and Other Language Experts.” Across Languages and Cultures (): –. 10.1556/084.2017.18.1.2
    https://doi.org/10.1556/084.2017.18.1.2 [Google Scholar]
  41. Rosiers, Alexandra, Koen Plevoets, and June Eyckmans
    2020 “Choosing to Become an Interpreter: A Matter of Personality and Memory Capacity.” Translation, Cognition & Behavior (): –. 10.1075/tcb.00033.ros
    https://doi.org/10.1075/tcb.00033.ros [Google Scholar]
  42. Ryan, Richard M., and Edward L. Deci
    2000 “Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions.” Contemporary Educational Psychology (): –. 10.1006/ceps.1999.1020
    https://doi.org/10.1006/ceps.1999.1020 [Google Scholar]
  43. Thompson, Edmund R.
    2008 “Development and Validation of an International English Big-Five Mini-Markers.” Personality and Individual Differences (): –. 10.1016/j.paid.2008.06.013
    https://doi.org/10.1016/j.paid.2008.06.013 [Google Scholar]
  44. Wallinheimo, Anna-Stiina, Simon L. Evans, and Elena Davitti
    2023 “Training in New Forms of Human-AI Interaction Improves Complex Working Memory and Switching Skills of Language Professionals.” Frontiers in Artificial Intelligence. 10.3389/frai.2023.1253940
    https://doi.org/10.3389/frai.2023.1253940 [Google Scholar]
  45. Wati Halim, Fatima, Arifin Zainal, Rozainee Khairudin, Wan Shahrazad, Wan Sulaiman, Rohany Nasir, and Fatimah Omar
    2011 “Emotional Stability and Conscientiousness as Predictors Towards Job Performance.” Pertanika Journal of Social Science and Humanities: –.
    [Google Scholar]
  46. Wilmot, Michael P., and Deniz S. Ones
    2019 “A Century of Research on Conscientiousness at Work.” Proceedings of the National Academy of Sciences (): –. 10.1073/pnas.1908430116
    https://doi.org/10.1073/pnas.1908430116 [Google Scholar]
  47. Wyer, Robert S.
    2022 “The Activation and Use of Declarative and Procedural Knowledge.” InAPA Handbook of Consumer Psychology, edited byLynn R. Kahle, Tina M. Lowrey, and Joel Huber, –. American Psychological Association. 10.1037/0000262‑002
    https://doi.org/10.1037/0000262-002 [Google Scholar]
  48. Xing, Xing, and Hua Zeng
    2022 “Exploring the Effects of Personality Hardiness on Interpreters’ Performance with Interpreting Anxiety as a Mediator: An Explanatory Sequential Mixed-Methods Study.” Across Languages and Cultures (): –. 10.1556/084.2022.00218
    https://doi.org/10.1556/084.2022.00218 [Google Scholar]
  49. Zaccaro, Stephen J.
    2007 “Trait-Based Perspectives of Leadership.” American Psychologist (): –. 10.1037/0003‑066X.62.1.6
    https://doi.org/10.1037/0003-066X.62.1.6 [Google Scholar]
/content/journals/10.1075/target.00035.dav
Loading
/content/journals/10.1075/target.00035.dav
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error