1887
Volume 12, Issue 2
  • ISSN 2212-8433
  • E-ISSN: 2212-8441
USD
Buy:$35.00 + Taxes

Abstract

Abstract

In bilingual education programs, students learn content knowledge through an additional language (L2). Their content knowledge is also assessed through their L2, which raises concerns about underestimating their actual learning. This study addresses such concerns by investigating the cognitive processes and strategies of bilingual learners when being assessed in their L2. 49 university students, divided into more proficient and less proficient L2 learners, participated in an eye-tracking experiment which captured their eye movements when attempting a biology assessment. They then reported their thinking processes and strategies during the assessment process in a stimulated recall. In general, the participants engaged in more cognitive processes when attempting questions that were more cognitively demanding and required productive language skills. The less proficient group had more and longer fixations and regressions than their more proficient counterparts, but the two groups reported similar strategies. These findings have implications for assessment design in bilingual education programs.

Loading

Article metrics loading...

/content/journals/10.1075/jicb.23011.ten
2023-12-11
2024-12-02
Loading full text...

Full text loading...

References

  1. Attar, Z., Blom, E., & Le Pichon, E.
    (2022) Towards more multilingual practices in the mathematics assessment of young refugee students: Effects of testing language and validity of parental assessment. International Journal of Bilingual Education and Bilingualism, 25(4), 1546–1561. 10.1080/13670050.2020.1779648
    https://doi.org/10.1080/13670050.2020.1779648 [Google Scholar]
  2. Broca, A.
    (2016) CLIL and non-CLIL: Differences from the outset. ELT Journal, 70(3), 320–331. 10.1093/elt/ccw011
    https://doi.org/10.1093/elt/ccw011 [Google Scholar]
  3. Brown, C. L.
    (2005) Equity of literacy-based math performance assessments for English language learners. Bilingual Research Journal, 29(2), 337–363. 10.1080/15235882.2005.10162839
    https://doi.org/10.1080/15235882.2005.10162839 [Google Scholar]
  4. Brown, L., Sherbenou, R. J., & Johnsen, S. K.
    (2010) Test of Nonverbal Intelligence (4th ed.) (TONI-4). Pro-Ed.
    [Google Scholar]
  5. Catrysse, L., Gijbels, D., Donche, V., de Maeyer, S., van den Bossche, P., & Gommers, L.
    (2016) Mapping processing strategies in learning from expository text: An exploratory eye tracking study followed by a cued recall. Frontline Learning Research, 4(1), 1–16. 10.14786/flr.v4i1.192
    https://doi.org/10.14786/flr.v4i1.192 [Google Scholar]
  6. Castellano-Risco, I., Alejo-González, R., & Piquer-Píriz, A. M.
    (2020) The development of receptive vocabulary in CLIL vs EFL: Is the learning context the main variable?System, 911, 102263. 10.1016/j.system.2020.102263
    https://doi.org/10.1016/j.system.2020.102263 [Google Scholar]
  7. Cummins, J.
    (1981) The role of primary language development in promoting educational success for language minority students. InCalifornia State Department of Education (Ed.), Schooling and Language Minority Students: A Theoretical Rationale (pp.3–49). California State University.
    [Google Scholar]
  8. Dalton-Puffer, C.
    (2013) A construct of cognitive discourse functions for conceptualising content-language integration in CLIL and multilingual education. European Journal of Applied Linguistics, 1(2), 216–253. 10.1515/eujal‑2013‑0011
    https://doi.org/10.1515/eujal-2013-0011 [Google Scholar]
  9. Dalton-Puffer, C., Hüttner, J., & Llinares, A.
    (2022) CLIL in the 21st Century: Retrospective and prospective challenges and opportunities. Journal of Immersion and Content-Based Language Education, 10(2), 182–206. 10.1075/jicb.21021.dal
    https://doi.org/10.1075/jicb.21021.dal [Google Scholar]
  10. Fernández-Sanjurjo, J., Fernández-Costales, A., & Blanco, J. M. A.
    (2019) Analysing students’ content-learning in science in CLIL vs. non-CLIL programmes: Empirical evidence from Spain. International Journal of Bilingual Education and Bilingualism, 22(6), 661–674. 10.1080/13670050.2017.1294142
    https://doi.org/10.1080/13670050.2017.1294142 [Google Scholar]
  11. García, O., & Sylvan, C.
    (2011) Pedagogies and practices in multilingual classrooms: Singularities in pluralities. The Modern Language Journal, 95(3), 85–400. 10.1111/j.1540‑4781.2011.01208.x
    https://doi.org/10.1111/j.1540-4781.2011.01208.x [Google Scholar]
  12. Gorter, G., & Cenoz, J.
    (2017) Language education policy and multilingual assessment. Language and Education, 31(3), 231–248. 10.1080/09500782.2016.1261892
    https://doi.org/10.1080/09500782.2016.1261892 [Google Scholar]
  13. Hawker, I. A.
    (2013) The CLIL learning experience: Strategies and underlying knowledge employed by limited English primary school students during conceptual and linguistics comprehension. InS. Breidbach & B. Viebrock (Eds.), Content and Language Integrated Learning (CLIL) in Europe (pp.159–179). Peter Lang.
    [Google Scholar]
  14. HKEAA (Hong Kong Examination and Assessment Authority)
    HKEAA (Hong Kong Examination and Assessment Authority) (2022) 2022 HKDSE entry statistics. https://www.hkeaa.edu.hk/DocLibrary/HKDSE/Exam_Report/Examination_Statistics/dseexamstat22_2.pdf
    [Google Scholar]
  15. Hsiao, J. H., & Cottrell, G. W.
    (2008) Two fixations suffice in face recognition. Psychological Science, 9(10), 998–1006. 10.1111/j.1467‑9280.2008.02191.x
    https://doi.org/10.1111/j.1467-9280.2008.02191.x [Google Scholar]
  16. Hultgren, A. K., Owen, N., Shrestha, P., Kuteeva, M., & Mežek, S.
    (2022) Assessment and English as a medium of instruction: Challenges and opportunities. Journal of English-Medium Instruction, 1(1), 105–123. 10.1075/jemi.21019.hul
    https://doi.org/10.1075/jemi.21019.hul [Google Scholar]
  17. Johnsen, S. K., Brown, L., & Sherbenou, R. J.
    (2010) Test of nonverbal intelligence: Critical reviews and research findings, 1982–2009. Pro-Ed.
    [Google Scholar]
  18. Just, M. A., & Carpenter, P. A.
    (1980) A theory of reading: From eye fixations to comprehension. Psychological Review, 87(4), 329–354. 10.1037/0033‑295X.87.4.329
    https://doi.org/10.1037/0033-295X.87.4.329 [Google Scholar]
  19. Kane, M., & Bejar, I.
    (2014) Cognitive frameworks for assessment, teaching, and learning: A validity perspective. Psicología Educativa, 201, 117–122. 10.1016/j.pse.2014.11.006
    https://doi.org/10.1016/j.pse.2014.11.006 [Google Scholar]
  20. Keating, G. D.
    (2014) Eye-tracking with text. InJ. Jegerski & B. VanPatten (Eds.), Research methods in second language psycholinguistics (pp.69–92). Routledge.
    [Google Scholar]
  21. Kroll, J. F., van Hell, J. G., Tokowicz, N., & Green, D. W.
    (2010) The revised hierarchical model: A critical review and assessment. Bilingualism: Language and Cognition, 13(3), 373–391. 10.1017/S136672891000009X
    https://doi.org/10.1017/S136672891000009X [Google Scholar]
  22. Lemhöfer, K., & Broersma, M.
    (2012) Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behaviour Research Methods, 441, 325–343. 10.3758/s13428‑011‑0146‑0
    https://doi.org/10.3758/s13428-011-0146-0 [Google Scholar]
  23. Lemke, J. L.
    (1990) Talking science: Language, learning and values. Ablex.
    [Google Scholar]
  24. Levin, T., & Shohamy, E.
    (2008) Achievement of immigrant students in mathematics and academic Herbrew in Israeli school: A large-scale evaluation study. Studies in Educational Evaluation, 34(1), 1–14. 10.1016/j.stueduc.2008.01.001
    https://doi.org/10.1016/j.stueduc.2008.01.001 [Google Scholar]
  25. Lin, A. M. Y.
    (2016) Language across the curriculum and CLIL in English as an Additional Language (EAL) contexts: theory and practice. Springer. 10.1007/978‑981‑10‑1802‑2
    https://doi.org/10.1007/978-981-10-1802-2 [Google Scholar]
  26. Lo, Y. Y., & Fung, D.
    (2020) Assessments in CLIL: The interplay between cognitive and linguistic demands and their progression in secondary education. International Journal of Bilingual Education and Bilingualism, 23(10), 1192–1210. 10.1080/13670050.2018.1436519
    https://doi.org/10.1080/13670050.2018.1436519 [Google Scholar]
  27. Lo, Y. Y., Fung, D., & Qiu, X.
    (2021) Assessing content knowledge through L2: Mediating role of language of testing on students’ performance. Journal of Multilingual and Multicultural Development. 10.1080/01434632.2020.1854274
    https://doi.org/10.1080/01434632.2020.1854274 [Google Scholar]
  28. Macaro, E.
    (2022) Learner strategies in an English Medium Instruction context. InB. Di Sabato & B. Hughes (Eds.), Multilingual perspectives from Europe and beyond on language policy and practice (pp.63–81). Routledge.
    [Google Scholar]
  29. Macaro, E., Briggs Baffoe-Djan, J., Rose, H., Di Sabato, B., Hughes, B., Cuccurullo, D., Coonan, C. M., Menegale, M., & Bier, A.
    (2019) Transition from Secondary School CLIL to EMI at University: Initial Evidence from Research in Italy. British Council. https://www.teachingenglish.org.uk/sites/teacheng/files/K081%20ELT%20Transition%20from%20secondary%20school_FINAL.pdf
    [Google Scholar]
  30. Massler, U., Stotz, D., & Queisser, C.
    (2014) Assessment instruments for primary CLIL: The conceptualisation and evaluation of test tasks. The Language Learning Journal, 42(2), 137–150. 10.1080/09571736.2014.891371
    https://doi.org/10.1080/09571736.2014.891371 [Google Scholar]
  31. Morton, T., & Llinares, A.
    (2017) Content and Language Integrated Learning: Type of programme or pedagogical model?InA. Llinares & T. Morton (Eds.), Applied Linguistics Perspectives on CLIL (pp.1–16). John Benjamins. 10.1075/lllt.47.01mor
    https://doi.org/10.1075/lllt.47.01mor [Google Scholar]
  32. Otto, A., & Estrada, J. L.
    (2019) Towards an Understanding of CLIL in a European Context: Main assessment tools and the role of language in content subjects. CLIL Journal of Innovation and Research in Plurilingual and Pluricultural Education, 2(1), 31–42. https://raco.cat/index.php/clil/article/view/359606. 10.5565/rev/clil.11
    https://doi.org/10.5565/rev/clil.11 [Google Scholar]
  33. Oxford, R. L.
    (1990) Language learning strategies: What every teacher should know. Heinle.
    [Google Scholar]
  34. Pavlenko, A.
    (2009) Conceptual representation in the bilingual lexicon and L2 vocabulary learning. InA. Pavlenko (Ed.), The Bilingual mental lexicon. interdisciplinary approaches (pp.125–160). Multilingual Matters. 10.21832/9781847691262‑008
    https://doi.org/10.21832/9781847691262-008 [Google Scholar]
  35. Pellicer-Sánchez, A.
    (2016) Incidental L2 vocabulary acquisition from and while reading. Studies in Second Language Acquisition, 38(1), 97–130. 10.1017/S0272263115000224
    https://doi.org/10.1017/S0272263115000224 [Google Scholar]
  36. Rayner, K.
    (2009) Eye movements and attention in reading, scene perception, and visual search. The Quarterly Journal of Experimental Psychology, 62(8), 1457–1506. 10.1080/17470210902816461
    https://doi.org/10.1080/17470210902816461 [Google Scholar]
  37. Shaw, S., & Imam, H.
    (2013) Assessment of international students through the medium of English: Ensuring validity and fairness in content-based examinations. Language Assessment Quarterly, 10(4), 452–475. 10.1080/15434303.2013.866117
    https://doi.org/10.1080/15434303.2013.866117 [Google Scholar]
  38. Shohamy, E.
    (2011) Assessing multilingual competencies: Adopting construct valid assessment policies. The Modern Language Journal, 95(3), 418–429. 10.1111/j.1540‑4781.2011.01210.x
    https://doi.org/10.1111/j.1540-4781.2011.01210.x [Google Scholar]
  39. Soruç, A. & Griffiths, C.
    (2018) English as a medium of instruction: students’ strategies. ELT Journal, 72(1), 38–48. 10.1093/elt/ccx017
    https://doi.org/10.1093/elt/ccx017 [Google Scholar]
  40. Soruç, A., Dinler, A., & Griffiths, C.
    (2018) Listening comprehension strategies of EMI students in Turkey. InY. Kırkgöz & K. Dikilitaş (Eds.), Key issues in English for Specific Purposes in higher education (pp.265–291). Springer. 10.1007/978‑3‑319‑70214‑8_15
    https://doi.org/10.1007/978-3-319-70214-8_15 [Google Scholar]
  41. Zheng, Y., Ye, X., & Hsiao, J. H.
    (2022) Does adding video and subtitles to an audio lesson facilitate its comprehension?Learning & Instruction, 771, 101542. 10.1016/j.learninstruc.2021.101542
    https://doi.org/10.1016/j.learninstruc.2021.101542 [Google Scholar]
/content/journals/10.1075/jicb.23011.ten
Loading
/content/journals/10.1075/jicb.23011.ten
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): assessment; bilingual education; cognitive processing; eye-tracking; strategies
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error