1887
  1. Home
  2. e-Journals
  3. Journal of Second Language Pronunciation
  4. Volume 10, Issue 3
  5. Article
Volume 10, Issue 3
  • ISSN 2215-1931
  • E-ISSN: 2215-194X
USD
Buy:$35.00 + Taxes

Abstract

While generative AI-based chatbots expand opportunities for L2 pronunciation practice, not all are designed for language learning or provide explicit feedback. Through a comparison of two chatbots, , which offers explicit pronunciation feedback, and , a general-purpose chatbot whose real-time transcription may serve as implicit feedback, this study explored whether practice with these chatbots had an impact on L2 English learners’ comprehensibility and whether any improvements were influenced by the presence of explicit feedback. Three groups of learners participated: two experimental groups, each practicing with one of the chatbots, and one control group. Although comprehensibility ratings indicated no statistically significant improvements at the group level based on training or the specific chatbot used, individual learners demonstrated improvements. These advancements were noted among motivated learners who completed most of their speaking sessions. Learners had positive impressions of their experience with the chatbots and believed that their practice contributed to their pronunciation improvement.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/jslp.24053.son
2025-02-25
2026-05-11

  • From This Site

    /content/journals/10.1075/jslp.24053.son
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Alharbi, S., Alrazgan, M., Alrashed, A., Alnomasi, T., Almojel, R., & Alharbi, R.
    (2021) Automatic speech recognition: Systematic literature review. IEEE Access, 91, 131858–131876. 10.1109/ACCESS.2021.3112535
     https://doi.org/10.1109/ACCESS.2021.3112535 [Google Scholar]
  2. Audacity Team
    Audacity Team (2024) Audacity (Version 3.3.3) [Computer software]. https://www.audacityteam.org/
     [Google Scholar]
  3. Bates, D., Mächler, M., Bolker, & Walker, S.
    (2015) Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1–48. 10.18637/jss.v067.i01
     https://doi.org/10.18637/jss.v067.i01 [Google Scholar]
  4. Belda-Medina, J., & Calvo-Ferrer, J. R.
    (2022) Using chatbots as AI conversational partners in language learning. Applied Sciences, 12(17), 8427. 10.3390/app12178427
     https://doi.org/10.3390/app12178427 [Google Scholar]
  5. Bibauw, S., François, T., & Desmet, P.
    (2019) Discussing with a computer to practice a foreign language: Research synthesis and conceptual framework of dialogue-based CALL. Computer Assisted Language Learning, 32(8), 827–877. 10.1080/09588221.2018.1535508
     https://doi.org/10.1080/09588221.2018.1535508 [Google Scholar]
  6. Bibauw, S., Van den Noortgate, W., François, T., & Desmet, P.
    (2022) Dialogue systems for language learning: A meta-analysis. Language Learning & Technology, 26(1), 1–24.
     [Google Scholar]
  7. Braun, V., & Clarke, V.
    (2012) Thematic analysis. InH. Cooper, P. M. Camic, D. L. Long, A. T. Panter, D. Rindskopf, & K. J. Sher (Eds.), APA handbook of research methods in psychology, Vol. 2. Research designs: Quantitative, qualitative, neuropsychological, and biological (pp.57–71). American Psychological Association. 10.1037/13620‑004
     https://doi.org/10.1037/13620-004 [Google Scholar]
  8. Cheng, V. C. W., Lau, V. K. T., Lam, R. W. K., Zhan, T. J., & Chan, P. K.
    (2020) Improving English phoneme pronunciation with automatic speech recognition using voice chatbot. InTechnology in Education. Innovations for Online Teaching and Learning: 5th International Conference, ICTE 2020, Macau, China, August 19–22, 2020, Revised Selected Papers 5 (pp.88–99). Springer Singapore. 10.1007/978‑981‑33‑4594‑2_8
     https://doi.org/10.1007/978-981-33-4594-2_8 [Google Scholar]
  9. Derwing, T. M., Rossiter, M., Munro, M. J., & Thomson, R. I.
    (2004) Second language fluency: Judgements on different tasks. Language Learning, 54(4), 655–679. 10.1111/j.1467‑9922.2004.00282.x
     https://doi.org/10.1111/j.1467-9922.2004.00282.x [Google Scholar]
  10. Dizon, G.
    (2017) Using intelligent personal assistants for second language learning: A case study of Alexa. TESOL Journal, 8(4), 811–830. 10.1002/tesj.353
     https://doi.org/10.1002/tesj.353 [Google Scholar]
  11. (2020) Evaluating intelligent personal assistants for L2 listening and speaking development. Language Learning & Technology, 24(1), 16–26.
     [Google Scholar]
  12. Firke, S.
    (2023) _janitor: Simple Tools for Examining and Cleaning Dirty Data_. R package version 2.2.0, 〈https://CRAN.R-project.org/package=janitor〉.
  13. Fouz-González, J.
    (2020) Using apps for pronunciation training: An empirical evaluation of the English File Pronunciation app. Language Learning & Technology, 24(1), 62–85. 10125/44709
     https://doi.org/10125/44709 [Google Scholar]
  14. Gemini
    Gemini (2024) Gemini (1.5 Flash). Large Language Model. https://www.gemini.com/
     [Google Scholar]
  15. Godwin-Jones, R.
    (2023) Emerging spaces for language learning: AI bots, ambient intelligence, and the metaverse. Language Learning & Technology, 27(2), 6–27.
     [Google Scholar]
  16. Golonka, E. M., Bowles, A. R., Frank, V. M., Richardson, D. L., & Freynik, S.
    (2014) Technologies for foreign language learning: A review of technology types and their effectiveness. Computer assisted language learning, 27(1), 70–105. 10.1080/09588221.2012.700315
     https://doi.org/10.1080/09588221.2012.700315 [Google Scholar]
  17. Guskaroska, A.
    (2024) Exploring technology acceptance of ASR for pronunciation learning. [Unpublished doctoral dissertation]. Iowa State University. Ames, IA, USA.
  18. Hartig, F.
    (2022) DHARMa: Residual diagnostics for hierarchical Multi-level / Mixed regression models. https://CRAN.R-project.org/package=DHARMa
  19. Henrichsen, L.
    (2019) A System for Analyzing and Evaluating Computer-Assisted Second-Language Pronunciation-Teaching Websites and Mobile Apps. InSociety for Information Technology & Teacher Education International Conference (pp.963–968). Association for the Advancement of Computing in Education (AACE).
     [Google Scholar]
  20. Hoang, N. T., Han, D. N., & Le, D. H.
    (2023) Exploring Chatbot AI in improving vocational students’ English pronunciation. AsiaCALL Online Journal, 14(2), 140–155. 10.54855/acoj.231429
     https://doi.org/10.54855/acoj.231429 [Google Scholar]
  21. Huang, W., Hew, K. F., & Fryer, L. K.
    (2022) Chatbots for language learning — Are they really useful? A systematic review of chatbot-supported language learning. Journal of Computer Assisted Learning, 38(1), 237–257. 10.1111/jcal.12610
     https://doi.org/10.1111/jcal.12610 [Google Scholar]
  22. Jeon, J.
    (2024) Exploring AI chatbot affordances in the EFL classroom: Young learners’ experiences and perspectives. Computer Assisted Language Learning, 37(1–2), 1–26. 10.1080/09588221.2021.2021241
     https://doi.org/10.1080/09588221.2021.2021241 [Google Scholar]
  23. Kaiser, D.
    (2018) Mobile-assisted pronunciation training: The iPhone pronunciation app project. IATEFL Pronunciation Special Interest Group Journal, 581, 38–52.
     [Google Scholar]
  24. Khampusaen, D., Chanprasopchai, T., & Lao-un, J.
    (2023) Empowering Thai Community-based Tourism Operators: Enhancing English Pronunciation Abilities with AI-based Lessons. Journal of Mekong Societies, 19(1), 132–159.
     [Google Scholar]
  25. Kim, N. Y.
    (2016) Effects of Voice Chat on EFL Learners’ Speaking Ability according to Proficiency Levels. Multimedia-Assisted Language Learning, 19(4).
     [Google Scholar]
  26. Kim, H. S., Cha, Y., & Kim, N. Y.
    (2021) Effects of AI chatbots on EFL students’ communication skills. Korean Journal of English Language and Linguistics, 211, 712–734.
     [Google Scholar]
  27. Lenth, R.
    (2023) _emmeans: Estimated Marginal Means, aka Least-Squares Means_. R package version 1.8.7, 〈https://CRAN.R-project.org/package=emmeans〉.
  28. Levis, J.
    (2007) Computer technology in teaching and researching pronunciation. Annual review of applied linguistics, 271, 184–202. 10.1017/S0267190508070098
     https://doi.org/10.1017/S0267190508070098 [Google Scholar]
  29. Liu, S. C., & Hung, P. Y.
    (2016) Teaching pronunciation with computer assisted pronunciation instruction in a technological university. Universal Journal of Educational Research, 4(9), 1939–1943. 10.13189/ujer.2016.040902
     https://doi.org/10.13189/ujer.2016.040902 [Google Scholar]
  30. Martins, C. G. D. F. M., Levis, J. M., & Borges, V. M. C.
    (2016) The design of an instrument to evaluate software for EFL/ESL pronunciation teaching. Ilha do Desterro, 691, 141–160. 10.5007/2175‑8026.2016v69n1p141
     https://doi.org/10.5007/2175-8026.2016v69n1p141 [Google Scholar]
  31. McCrocklin, S., & Edalatishams, I.
    (2020) Revisiting popular speech recognition software for ESL speech. TESOL Quarterly, 54(4), 1086–1097. 10.1002/tesq.3006
     https://doi.org/10.1002/tesq.3006 [Google Scholar]
  32. Mizumoto, A., & Eguchi, M.
    (2023) Exploring the potential of using an AI language model for automated essay scoring. Research Methods in Applied Linguistics, 2(2), 100050. 10.1016/j.rmal.2023.100050
     https://doi.org/10.1016/j.rmal.2023.100050 [Google Scholar]
  33. Mohammadkarimi, E.
    (2024) Exploring the use of artificial intelligence in promoting English language pronunciation skills. LLT Journal: A Journal on Language and Language Teaching, 27(1), 98–115. 10.24071/llt.v27i1.8151
     https://doi.org/10.24071/llt.v27i1.8151 [Google Scholar]
  34. Nagle, C.
    (2019) Developing and validating a methodology for crowdsourcing L2 speech ratings in Amazon Mechanical Turk. Journal of Second Language Pronunciation, 5(2), 292–323. 10.1075/jslp.18016.nag
     https://doi.org/10.1075/jslp.18016.nag [Google Scholar]
  35. (2025) A guide to quantitative research methods in second language pronunciation. Routledge.
     [Google Scholar]
  36. Neri, A., Cucchiarini, C., & Strik, H.
    (2003) Automatic Speech Recognition for second language learning: How and why it actually works. Proceedings of the 15th International Congress of Phonetic Sciences, (pp.1157–1160).
     [Google Scholar]
  37. Ngueajio, M. K., & Washington, G.
    (2022) Hey ASR system! Why aren’t you more inclusive? automatic speech recognition systems’ bias and proposed bias mitigation techniques. a literature review. InInternational Conference on Human-Computer Interaction (pp.421–440). Cham: Springer Nature Switzerland.
     [Google Scholar]
  38. Pennington, M. C., & Rogerson-Revell, P.
    (2019) Using Technology for Pronunciation Teaching, Learning, and Assessment. In: English Pronunciation Teaching and Research. Research and Practice in Applied Linguistics. Palgrave Macmillan. 10.1057/978‑1‑137‑47677‑7_5
     https://doi.org/10.1057/978-1-137-47677-7_5 [Google Scholar]
  39. Pronounce
    Pronounce (2024) Pronounce Inc. www.getpronounce.com
     [Google Scholar]
  40. Revelle, W.
    (2023) psych: Procedures for Psychological, Psychometric, and Personality Research. Northwestern University, Evanston, Illinois, USA. R package version 2.3.6, https://CRAN.R-project.org/package=psych
     [Google Scholar]
  41. Rogerson-Revell, P. M.
    (2021) Computer-assisted pronunciation training (CAPT): Current issues and future directions. RELC Journal, 52(1), 189–205. 10.1177/0033688220977406
     https://doi.org/10.1177/0033688220977406 [Google Scholar]
  42. Tejedor-García, C., Escudero-Mancebo, D., Cámara-Arenas, E., González-Ferreras, C., & Cardeñoso-Payo, V.
    (2020) Assessing pronunciation improvement in students of English using a controlled computer-assisted pronunciation tool. IEEE Transactions on Learning Technologies, 13(2), 269–282. 10.1109/TLT.2020.2980261
     https://doi.org/10.1109/TLT.2020.2980261 [Google Scholar]
  43. Thomson, R. I.
    (2011) Computer assisted pronunciation training: Targeting second language vowel perception improves pronunciation. CALICO Journal, 28(3), 744–765. 10.11139/cj.28.3.744‑765
     https://doi.org/10.11139/cj.28.3.744-765 [Google Scholar]
  44. Walesiak, B.
    (2017) Mobile pron. apps–a personal investigation. Speak Out! Journal of the IATEFL Pronunciation Special Interest Group, 571, 16–28.
     [Google Scholar]
  45. Wassink, A. B., Gansen, C., & Bartholomew, I.
    (2022) Uneven success: automatic speech recognition and ethnicity-related dialects. Speech Communication, 1401, 50–70. 10.1016/j.specom.2022.03.009
     https://doi.org/10.1016/j.specom.2022.03.009 [Google Scholar]
  46. Weizenbaum, J.
    (1966) ELIZA: a computer program for the study of natural language communication between man and machine. Communications of the ACM9(1): 36–45. 10.1145/365153.365168
     https://doi.org/10.1145/365153.365168 [Google Scholar]
  47. Wickham, H., & Grolemund, G.
    (2017) R for data science: Visualize, model, transform, tidy, and import data. Boston, MA: O’Reilly Media. https://r4ds.had.co.nz/
     [Google Scholar]
/content/journals/10.1075/jslp.24053.son
Loading
The impact of generative AI-powered chatbots on L2 comprehensibility
Journal of Second Language Pronunciation 10, 339 (2024); https://doi.org/10.1075/jslp.24053.son
/content/journals/10.1075/jslp.24053.son
/content/journals/10.1075/jslp.24053.son
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): chatbot; comprehensibility; feedback; Gemini; GenAI; generative AI; Pronounce; voicebot

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error