1887
  1. Home
  2. e-Journals
  3. AILA Review
  4. Volume 38, Issue 1
  5. Article
Volume 38, Issue 1
  • ISSN 1461-0213
  • E-ISSN: 1570-5595
USD
Buy:$35.00 + Taxes

Abstract

Abstract

In investigating second language (L2) listening, verbal report (VR) can provide direct insight into listeners’ behaviors. However, a concern over this method is its potential for reactivity — that the VR may change (either positively or negatively) the individual’s cognitive processes involved in the task being investigated. Thus far, few studies have examined for reactivity in L2 listener VRs, and none have investigated it from a quantitative perspective, a gap which is addressed in this study. The study involved lower-intermediate to intermediate-level Mandarin-speaking English learners, and it compared the listening comprehension of an experimental group undertaking VRs with that of control groups assessed through recall protocols. No significant impact on comprehension was found for the VRs indicating, by extension, no interference with the listeners’ thought processes, and thus no apparent reactive effect. The study additionally examined for reactivity: (1) among three different VR styles (styles 1 and 2 were mediated styles, with each of these styles mediated in differing ways by researcher prompts, and style 3 was an unmediated VR); and (2) for mediated VRs, in general (the combination of styles 1 and 2). None of the analyses found a significant effect on comprehension. One further analysis, which lacked a control group, though, concluded there was a slight comprehension advantage for one of the mediated VR styles over the other two styles. The study had its limitations, but the findings suggest L2 listener VRs do not generally appear to be reactive, suggesting they are suitable for use by researchers investigating L2 listeners.

© AILA
Loading

Article metrics loading...

/content/journals/10.1075/aila.24035.yel
2025-08-18
2026-04-13

  • From This Site

    /content/journals/10.1075/aila.24035.yel
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Al-Maani, A., AlAbabneh, B., Mashaqba, B., & Huneety, A.
    (2024) Investigating second language learning strategies using think aloud protocols: Evidence from Jordanian EFL learners. Eurasian Journal of Applied Linguistics, 10(2), 12–22.
     [Google Scholar]
  2. Atkinson, R. C., & Shiffrin, R. M.
    (1968) Human memory: A proposed system and its control processes. Psychology of Learning and Motivation, 21, 89–195. 10.1016/S0079‑7421(08)60422‑3
     https://doi.org/10.1016/S0079-7421(08)60422-3 [Google Scholar]
  3. Bacon, S. M.
    (1992) Authentic listening in Spanish: How learners adjust their strategies to the difficulty of the input. Hispania, 75(2), 398–412. 10.2307/344077
     https://doi.org/10.2307/344077 [Google Scholar]
  4. Bonk, W. J.
    (2000) Second language lexical knowledge and listening comprehension. International Journal of Listening, 14(11), 14–31. 10.1080/10904018.2000.10499033
     https://doi.org/10.1080/10904018.2000.10499033 [Google Scholar]
  5. Bowles, M. A.
    (2010) The think-aloud controversy in second language research. Routledge. 10.4324/9780203856338
     https://doi.org/10.4324/9780203856338 [Google Scholar]
  6. (2019) Verbal reports in instructed SLA research. InR. P. Leow (Ed.), The Routledge handbook of second language research in classroom learning (pp.31–43). Routledge. 10.4324/9781315165080‑3
     https://doi.org/10.4324/9781315165080-3 [Google Scholar]
  7. Brunfaut, T., & Harding, L.
    (2014) Linking the GEPT listening test to the Common European Framework of Reference. LTTC-GEPT Research Reports RG-05. LTTC, Taiwan.
     [Google Scholar]
  8. Buck, G.
    (1990) The testing of second language listening comprehension. Unpublished doctoral dissertation, University of Lancaster.
  9. Bulut, B., & Ertem, I. S.
    (2018) A think-aloud study: Listening comprehension strategies used by primary school students. Journal of Education and Training Studies, 6(5), 135–143. 10.11114/jets.v6i5.3050
     https://doi.org/10.11114/jets.v6i5.3050 [Google Scholar]
  10. Carney, N.
    (2021) Diagnosing L2 listeners’ difficulty comprehending known lexis, TESOL Quarterly, 55(2), 536–567. 10.1002/tesq.3000
     https://doi.org/10.1002/tesq.3000 [Google Scholar]
  11. Chien, C. N.
    (2001) How do the video tapes help with interpreting oral input?Chung Yuan Journal, 29(2), 159–173.
     [Google Scholar]
  12. Cohen, A. D.
    (1998) Strategies in learning and using a second language. Longman.
     [Google Scholar]
  13. (2011) Strategies in learning and using a second language (2nd ed.). Longman Applied Linguistics/Pearson.
     [Google Scholar]
  14. (2023) System’s 50th anniversary special issue in conversation with Andrew D. Cohen. System, 1181, Article 103153. 10.1016/j.system.2023.103153
     https://doi.org/10.1016/j.system.2023.103153 [Google Scholar]
  15. Cohen, J.
    (1988) Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates.
     [Google Scholar]
  16. Ericsson, K. A., & Simon, H. A.
    (1984) Protocol analysis: Verbal reports as data. MIT Press.
     [Google Scholar]
  17. (1993) Protocol analysis: Verbal reports as data. (Revised ed.). MIT Press. 10.7551/mitpress/5657.001.0001
     https://doi.org/10.7551/mitpress/5657.001.0001 [Google Scholar]
  18. Færch, C., & Kasper, G.
    (1987) From product to process — introspective methods in second language research. InC. Færch & G. Kasper (Eds.), Introspection in second language research (pp.5–23). Multilingual Matters.
     [Google Scholar]
  19. Foster, P., Tonkin, A., Wigglesworth, G.
    (2000) Measuring spoken language: A unit for all reasons. Applied Linguistics, 21(3), 345–375. 10.1093/applin/21.3.354
     https://doi.org/10.1093/applin/21.3.354 [Google Scholar]
  20. Gass, S.
    (2015) Experimental research. InB. Paltridge & A. Phakiti (Eds.), Research methods in applied linguistics: A practical resource (pp.101–118). Bloomsbury Academic.
     [Google Scholar]
  21. Goh, C. C. M.
    (1998) How ESL learners with different listening abilities use comprehension strategies and tactics. Language Teaching Research, 2(2), 124–147. 10.1177/136216889800200203
     https://doi.org/10.1177/136216889800200203 [Google Scholar]
  22. (2002) Exploring listening comprehension tactics and their interaction patterns. System, 30(2), 185–206. 10.1016/S0346‑251X(02)00004‑0
     https://doi.org/10.1016/S0346-251X(02)00004-0 [Google Scholar]
  23. (2023) Learners’ cognitive processing problems during comprehension as a basis for L2 listening research. System, 1191, Article 103164. 10.1016/j.system.2023.103164
     https://doi.org/10.1016/j.system.2023.103164 [Google Scholar]
  24. Goh, C. C. M., & Vandergrift, L.
    (2022) Teaching and learning second language listening (2nd ed.). Routledge.
     [Google Scholar]
  25. Graham, S.
    (1997) Effective language learning: Positive strategies for advanced level language learning. Multilingual Matters.
     [Google Scholar]
  26. Graham, S., Santos, D., & Vanderplank, R.
    (2011) Exploring the relationship between listening development and strategy use. Language Teaching Research, 15(4), 435–456. 10.1177/1362168811412026
     https://doi.org/10.1177/1362168811412026 [Google Scholar]
  27. Gu, P. Y., Hu, G., & Zhang, L. J.
    (2005) Investigating language learner strategies among lower primary school pupils in Singapore. Language Education, 19(4), 281–303. 10.1080/09500780508668682
     https://doi.org/10.1080/09500780508668682 [Google Scholar]
  28. (2009) Listening strategies of Singaporean primary pupils. InR. E. Silver, C. C. M. Goh, & L. Alsagoff (Eds.), Language learning in new English contexts: Studies of acquisition and development (pp.55–74). Continuum.
     [Google Scholar]
  29. Harding, L. W.
    (2018) Listening to an unfamiliar accent: Exploring difficulty, strategy use, and evidence of adaptation on listening assessment tasks. InG. J. Ockey & E. Wagner (Eds.). Assessing L2 listening: Moving towards authenticity (pp.98–112). John Benjamins. 10.1075/lllt.50.07har
     https://doi.org/10.1075/lllt.50.07har [Google Scholar]
  30. Jourdenais, R.
    (2001) Cognition, instruction and protocol analysis. InP. Robinson (Ed.), Cognition and second language instruction (pp.354–375). Cambridge University Press. 10.1017/CBO9781139524780.014
     https://doi.org/10.1017/CBO9781139524780.014 [Google Scholar]
  31. Laviosa, F.
    (2000) The listening processes and strategies of learners of Italian: A case study. Rassegna Italiana di Linguistica Applicata, 32(2), 129–159.
     [Google Scholar]
  32. Nisbett, R. E., & Wilson, T. D.
    (1977) Telling more than we can know: Verbal reports on mental processes. Psychological Review, 84(3), 231–259. 10.1037/0033‑295X.84.3.231
     https://doi.org/10.1037/0033-295X.84.3.231 [Google Scholar]
  33. Norris, J. M.
    (2015) Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 651 (supplement 1), 97–126. 10.1111/lang.12114
     https://doi.org/10.1111/lang.12114 [Google Scholar]
  34. Peters, M.
    (1999) The listening comprehension strategies of students in a French immersion program. Unpublished doctoral dissertation, University of Ottawa.
  35. Plonsky, L. D.
    (2015) Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. InL. D. Plonsky (Ed.), Advancing quantitative methods in second language research (pp.23–45). Routledge. 10.4324/9781315870908‑3
     https://doi.org/10.4324/9781315870908-3 [Google Scholar]
  36. Plonsky, L. D. & Oswald, R. L.
    (2014) How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64(4), 878–912. 10.1111/lang.12079
     https://doi.org/10.1111/lang.12079 [Google Scholar]
  37. Pressley, M., & Afflerbach, P.
    (1995) Verbal protocols of reading: The nature of constructively responsive reading. Lawrence Erlbaum Associates.
     [Google Scholar]
  38. Roever, C. & Pan, Y. C.
    (2008) Test Reviews. GEPT: General English Proficiency Test. Language Testing, 25(3), 403–418. 10.1177/0265532208090159
     https://doi.org/10.1177/0265532208090159 [Google Scholar]
  39. Rost, M.
    (2001) Listening. InR. Carter & D. Nunan (Eds.), The Cambridge guide to teaching English to speakers of other languages (pp.7–13). Cambridge University Press. 10.1017/CBO9780511667206.002
     https://doi.org/10.1017/CBO9780511667206.002 [Google Scholar]
  40. Sakai, H.
    (2011) Effect of repetition of exposure and proficiency level in L2 listening tests, TESOL Quarterly, 43(2), 360–372.
     [Google Scholar]
  41. Seliger, H. W.
    (1983) The language learner as linguist: Of metaphors and realities. Applied Linguistics, 4(3), 179–191. 10.1093/applin/4.3.179
     https://doi.org/10.1093/applin/4.3.179 [Google Scholar]
  42. Smagorinsky, P.
    (2001) Rethinking protocol analysis from a cultural perspective. Annual Review of Applied Linguistics, 211, 233–245. 10.1017/S0267190501000149
     https://doi.org/10.1017/S0267190501000149 [Google Scholar]
  43. Smith, P., Kim, D., Vorobel, O., & King, J. R.
    (2020) Verbal reports in the reading processes of language learners: A methodological review. Review of Education, 8(1), 37–114. 10.1002/rev3.3170
     https://doi.org/10.1002/rev3.3170 [Google Scholar]
  44. Suh, B.-R.
    (2023) Are think-alouds reactive? Evidence from an L2 written corrective feedback study. Language Teaching Research, 27(5), 1099–1119. 10.1177/1362168820967166
     https://doi.org/10.1177/1362168820967166 [Google Scholar]
  45. Vandergrift, L.
    (1998) Successful and less successful listeners in French: What are the strategy differences?The French Review, 71(3), 370–395.
     [Google Scholar]
  46. (2003) Orchestrating strategy use: Toward a model of the skilled second language listener. Language Learning, 53(3), 463–496. 10.1111/1467‑9922.00232
     https://doi.org/10.1111/1467-9922.00232 [Google Scholar]
  47. Vogely, A.
    (1995) Perceived strategy use during performance of three authentic listening comprehension tasks. The Modern Language Journal, 79(1), 41–56. 10.1111/j.1540‑4781.1995.tb05414.x
     https://doi.org/10.1111/j.1540-4781.1995.tb05414.x [Google Scholar]
  48. Wagner, M.
    (2006) Utilizing the visual channel: An investigation of the use of video texts on tests of second language listening ability. Unpublished doctoral dissertation. Teachers College, Columbia University.
  49. Yeldham, M.
    (2009) Approaches to second language listening instruction: Investigating the ‘top-down/bottom-up’ debate. Unpublished doctoral dissertation. University of Melbourne.
  50. Yeldham, M., & Chen, R. T.-H.
    (2014) Conducting verbal reports to study Chinese-speaking English learners’ listening: The use of prompts. The European Journal of Applied Linguistics and TEFL, 3(1), 55–74.
     [Google Scholar]
  51. (2016) Investigating mediation styles of second language listener verbal reports. Applied Linguistics Review, 7(2), 203–233. 10.1515/applirev‑2016‑0006
     https://doi.org/10.1515/applirev-2016-0006 [Google Scholar]
  52. Yeldham, M., & Gruba, P.
    (2014) Toward an instructional approach to developing interactive second language listening. Language Teaching Research, 18(1), 33–53. 10.1177/1362168813505395
     https://doi.org/10.1177/1362168813505395 [Google Scholar]
  53. (2016) The development of individual learners in an L2 listening strategies course. Language Teaching Research, 20(1), 9–34. 10.1177/1362168814541723
     https://doi.org/10.1177/1362168814541723 [Google Scholar]
/content/journals/10.1075/aila.24035.yel
Loading
Investigating reactivity in L2 listener verbal reports
AILA Review 38, 66 (2025); https://doi.org/10.1075/aila.24035.yel
/content/journals/10.1075/aila.24035.yel
/content/journals/10.1075/aila.24035.yel
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): Mandarin-speaking English learners; second language listeners; second language research methods; verbal report; verbal report reactivity

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error