1887
image of The Machine Translation Post-Editing Annotation System (MTPEAS)
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Machine translation post-editing quality evaluation has received relatively little attention in translation pedagogy to date. It is a time-consuming process that involves the comparison of three texts (source text, machine translation and student post-edited text) and the systematic identification and correction of students’ edits (or absence thereof) of machine translation (MT) output. There are as yet no widely available, standardized, user-friendly annotation systems for use in translator education. In this article, we address this gap by describing the (MTPEAS). MTPEAS includes a taxonomy of seven categories that are presented in easy-to-understand terms: Value-adding edits, Successful edits, Unnecessary edits, Incomplete edits, Error-introducing edits, Unsuccessful edits, and Missing edits. We then assess the robustness of the MTPEAS taxonomy in a pilot study of 30 students’ post-edited texts and offer some preliminary findings on students’ MT error identification and correction skills.

Loading

Article metrics loading...

/content/journals/10.1075/ts.24002.bod
2024-09-09
2024-10-06
Loading full text...

Full text loading...

References

  1. Blain, Frédéric, Jean Senellart, Holger Schwenk, Mirko Plitt, and Johann Roturier
    2011 “Qualitative analysis of post-editing for high quality machine translation.” InProceedings of Machine Translation Summit XIII: Papers, –.
    [Google Scholar]
  2. Castagnoli, Sara, Dragos Ciobanu, Natalie Kübler, Kerstin Kunz, and Alexandra Volanschi
    2011 “Designing a learner translator corpus for training purposes.” InCorpora, language, teaching, and resources: From theory to practice, edited byNatalie Kübler, –. Peter Lang.
    [Google Scholar]
  3. Castilho, Sheila, Stephen Doherty, Federico Gaspari, and Joss Moorkens
    2018 “Approaches to Human and Machine Translation Quality Assessment.” InTranslation Quality Assessment, edited byJoss Moorkens, Sheila Castilho, Federico Gaspari, and Stephen Doherty, –. Cham: Springer. 10.1007/978‑3‑319‑91241‑7_2
    https://doi.org/10.1007/978-3-319-91241-7_2 [Google Scholar]
  4. Daems, Joke, Sonia Vandepitte, Robert J. Hartsuiker, and Lieve Macken
    2017 “Translation Methods and Experience: A Comparative Analysis of Human Translation and Post-editing with Students and Professional Translators.” Meta (): –. 10.7202/1041023ar
    https://doi.org/10.7202/1041023ar [Google Scholar]
  5. De Almeida, Giselle
    2013 Translating the post-editor: an investigation of post-editing changes and correlations with professional experience across two Romance languages. PhD Thesis, Dublin City University.
    [Google Scholar]
  6. Doherty, Stephen, and Dorothy Kenny
    2014 “The design and evaluation of a Statistical Machine Translation syllabus for translation students.” The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2014.937571
    https://doi.org/10.1080/1750399X.2014.937571 [Google Scholar]
  7. Doherty, Stephen, Joss Moorkens, Federico Gaspari, and Sheila Castilho
    2018 “On education and training in translation quality assessment.” InTranslation Quality Assessment, edited byJoss Moorkens, Sheila Castilho, Federico Gaspari, and Stephen Doherty, –. Cham: Springer. 10.1007/978‑3‑319‑91241‑7_5
    https://doi.org/10.1007/978-3-319-91241-7_5 [Google Scholar]
  8. EMT Expert Group
    EMT Expert Group 2022 “Competence Framework”. AccessedJanuary 19, 2024. https://commission.europa.eu/system/files/2022-11/emt_competence_fwk_2022_en.pdf
  9. Froeliger, Nicolas, Claire Larsonneur, and Giuseppe Sofo
    (eds) 2023Traduction humaine et traitement automatique des langues: Vers un nouveau consensus?/Human Translation and Natural Language Processing: Forging a New Consensus?Studi e ricerche 35. Edizioni Ca’ Foscari – Venice University Press: Venice.
    [Google Scholar]
  10. Gene, Viveta, and Lucía Guerrero
    2022 “A Common Machine Translation Post-Editing Training Handbook for Academia, Clients, LSPs and Post-Editors.” GALA MTPE Training Special Interest Group.
    [Google Scholar]
  11. Ginovart Cid, Clara, and Carme Colominas Ventura
    2021 “The MT post-editing skill set: Course descriptions and educators’ thoughts.” InTranslation Revision and Post-editing: Industry Practices and Cognitive Processes, edited byMaarit Koponen, Brian S. Mossop, Isabelle Robert, and Giovanna Schocchera, –. London/New York: Routledge.
    [Google Scholar]
  12. Granger, Sylviane, and Marie-Aude Lefer
    2023 “Learner translation corpora: Bridging the gap between learner corpus research and corpus-based translation studies.” International Journal of Learner Corpus Research (): –. 10.1075/ijlcr.00032.gra
    https://doi.org/10.1075/ijlcr.00032.gra [Google Scholar]
  13. 2021 “Translation-oriented Annotation System manual (Version 2.0).” CECL Papers 3. Louvain-la-Neuve: Centre for English Corpus Linguistics/Université catholique de Louvain. AccessedJanuary 19, 2024. https://uclouvain.be/en/research-institutes/ilc/cecl/cecl-papers.html
    [Google Scholar]
  14. 2020 “The Multilingual Student Translation corpus: A resource for translation teaching and research.” Language Resources and Evaluation: –. 10.1007/s10579‑020‑09485‑6
    https://doi.org/10.1007/s10579-020-09485-6 [Google Scholar]
  15. Guerberof, Ana, and Joss Moorkens
    2019 “Machine translation and post-editing training as part of a master’s programme.” The Journal of Specialised Translation: –.
    [Google Scholar]
  16. Hu, Ke, and Patrick Cadwell
    2016 “A Comparative Study of Post-editing Guidelines.” Baltic J. Modern Computing (): –.
    [Google Scholar]
  17. Huertas Barros, Elsa, and Juliet Vine
    (eds) 2018New Perspectives in Assessment in Translator Training. London: Routledge.
    [Google Scholar]
  18. Kenny, Dorothy
    2020 “Technology and translator training.” InThe Routledge Handbook of Translation and Technology, edited byMinako O’Hagan, –. London: Routledge.
    [Google Scholar]
  19. Kenny, Dorothy and Doherty Stephen
    2014 “Statistical machine translation in the translation curriculum: overcoming obstacles and empowering translators.” The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2014.936112
    https://doi.org/10.1080/1750399X.2014.936112 [Google Scholar]
  20. Konttinen, Kalle, Leena Salmi, and Maarit Koponen
    2021 “Revision and post-editing competences in translation education.” InTranslation Revision and Post-editing: Industry Practices and Cognitive Processes, edited byMaarit Koponen, Brian S. Mossop, Isabelle Robert, and Giovanna Schocchera, –. London/New York: Routledge.
    [Google Scholar]
  21. Koponen, Maarit
    2015 “How to teach machine translation post-editing? Experiences from a post-editing course.” InProceedings of 4th Workshop on post-editing technology and practice, Miami, USA, October 30 to November 3, 2015, –. AccessedJanuary 19, 2024. https://mt-archive.net/15/MTS-2015-W1-Koponen.pdf
    [Google Scholar]
  22. Koponen, Maarit and Leena Salmi
    2017 “Post-editing quality: Analysing the correctness and necessity of post-editor corrections.” Linguistica Antverpiensia, New Series: Themes in Translation Studies: –.
    [Google Scholar]
  23. Koponen, Maarit, Leena Salmi, and Markku Nikulin
    2019 “A product and process analysis of post-editor corrections on neural, statistical and rule-based machine translation output.” Machine Translation (): –. 10.1007/s10590‑019‑09228‑7
    https://doi.org/10.1007/s10590-019-09228-7 [Google Scholar]
  24. Kübler, Natalie, Alexandra Mestivier, and Mojca Pecman
    2022 “Using comparable corpora for translating and post-editing complex noun phrases in specialized texts. Insights from English-to-French specialized translation.” InExtending the Scope of Corpus-Based Translation Studies, edited bySylviane Granger and Marie-Aude Lefer, –. London: Bloomsbury. 10.5040/9781350143289.0018
    https://doi.org/10.5040/9781350143289.0018 [Google Scholar]
  25. Kunilovskaya, Maria
    2015 “How far do we agree on the quality of translation?” English Studies at NBU (): –. 10.33919/esnbu.15.1.2
    https://doi.org/10.33919/esnbu.15.1.2 [Google Scholar]
  26. Landis, J. Richard, and Koch, Gary G.
    1977 “The measurement of observer agreement for categorical data.” Biometrics: –. 10.2307/2529310
    https://doi.org/10.2307/2529310 [Google Scholar]
  27. Lefer, Marie-Aude, Romane Bodart, Adam Obrusník, and Justine Piette
    2023 The Post-Edit Me! project. InProceedings of the 24th Annual Conference of the European Association for Machine Translation, –.
    [Google Scholar]
  28. Lefer, Marie-Aude, Romane Bodart, Justine Piette, and Adam Obrusník
    2024 “MTPE quality evaluation in translator education: the postedit.me app.” EAMT2024, Sheffield.
    [Google Scholar]
  29. Lipnevich, Anastasiya A., and Ernesto Panadero
    2021 “A review of feedback models and theories: Descriptions, definitions, and conclusions.” Frontiers in Education: . 10.3389/feduc.2021.720195
    https://doi.org/10.3389/feduc.2021.720195 [Google Scholar]
  30. Massey, Gary, Maria Piotrowska, and Mariusz Marczak
    2023 “(Re-) profiling T&I education: meeting evolution with innovation”. The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2023.2237321
    https://doi.org/10.1080/1750399X.2023.2237321 [Google Scholar]
  31. Mellinger, Christopher D.
    2017 “Translators and machine translation: knowledge and skills gaps in translator pedagogy.” The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2017.1359760
    https://doi.org/10.1080/1750399X.2017.1359760 [Google Scholar]
  32. Nitzke, Jean, Anke Tardel, and Silvia Hansen-Schirra
    2019 “Training the modern translator – the acquisition of digital competencies through blended learning”. The Interpreter and Translator Trainer (): –. 10.1080/1750399X.2019.1656410
    https://doi.org/10.1080/1750399X.2019.1656410 [Google Scholar]
  33. O’Brien, Sharon
    2002 “Teaching post-editing: a proposal for course content.” InProceedings of the 6th EAMT Workshop: Teaching machine translation, Manchester, England, November 14–15, 2002, –. AccessedJanuary 19, 2024. https://aclanthology.org/2002.eamt-1.11.pdf
    [Google Scholar]
  34. Pavlović, Nataša, and Goranka Antunović
    2021 “Towards acquiring post-editing abilities through research-informed practical tasks.” Strani jezici: časopis za primijenjenu lingvistiku (): –. 10.22210/strjez/50‑2/2
    https://doi.org/10.22210/strjez/50-2/2 [Google Scholar]
  35. Plaza Lara, Cristina
    2019 “SWOT Analysis of the Inclusion of Machine Translation and Post -Editing in the Master’s Degrees Offered in the EMT Network.” The Journal of Specialised Translation: –.
    [Google Scholar]
  36. Rico, Celia, and Diana Gonzalez Pastor
    2022 “The Role of Machine Translation in Translation Education: A Thematic Analysis of Translator Educators’ Beliefs.” Translation & Interpreting (): –. 10.12807/ti.114201.2022.a010
    https://doi.org/10.12807/ti.114201.2022.a010 [Google Scholar]
  37. Robert, Isabelle S., Iris Schrijver, and Jim J. J. Ureel
    2023 “Comparing L2 translation, translation revision, and post-editing competences in translation trainees: An exploratory study into Dutch-French translation.” Babel (): –. 10.1075/babel.00307.rob
    https://doi.org/10.1075/babel.00307.rob [Google Scholar]
  38. Schumacher, Perrine
    2023 La post-édition de traduction automatique en contexte d’apprentissage. PhD Thesis, University of Liège and University of Geneva.
    [Google Scholar]
  39. Stasimioti, Maria, and Vilelmini Sosoni
    2021 “Investigating post-editing: A mixed-methods study with experienced and novice translators in the English-Greek language pair.” InTranslation, interpreting, cognition: The way out of the box, edited byTra&Co Group, –. Berlin: Language Science Press. 10.5281/zenodo.4545037
    https://doi.org/10.5281/zenodo.4545037 [Google Scholar]
  40. Strobl, Carola
    2022 “Revision behaviour of translation students in response to electronic feedback. Insights from a pilot study using Hypal4MUST.” Paper presented atEST conference 2022, Oslo, Norway, 22–25 June 2022.
  41. Yamada, Masaru
    2019 “The impact of Google neural machine translation on post-editing by student translators.” The Journal of Specialised Translation (): –.
    [Google Scholar]
/content/journals/10.1075/ts.24002.bod
Loading
/content/journals/10.1075/ts.24002.bod
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error