oa Academic and general language proficiency in post-entry language assessment

References

1. Angoff, W. H., & Sharon, A. T.
   (1971) A comparison of scores earned on the Test of English as a Foreign Language by native American college students and foreign applicants to U.S. colleges. TESOL Quarterly, 5(2), 129–136. 10.2307/3585995
   https://doi.org/10.2307/3585995 [Google Scholar]
2. Biber, D.
   (2006) University language: A corpus-based study of spoken and written registers. John Benjamins. 10.1075/scl.23
   https://doi.org/10.1075/scl.23 [Google Scholar]
3. Bridgeman, B., Cho, Y., & DiPietro, S.
   (2016) Predicting grades from an English language assessment: The importance of peeling the onion. Language Testing, 33(3), 307–318. 10.1177/0265532215583066
   https://doi.org/10.1177/0265532215583066 [Google Scholar]
4. Cho, Y., & Bridgeman, B.
   (2012) Relationship of TOEFL iBT® scores to academic performance: Some evidence from American universities. Language Testing, 29(3), 421–442. 10.1177/0265532211430368
   https://doi.org/10.1177/0265532211430368 [Google Scholar]
5. Clark, J. L.
   (1977) The performance of native speakers of English on the Test of English as a Foreign Language. TOEFL Research Reports, 1.
   [Google Scholar]
6. Cohen, J.
   (1988) Statistical power analysis for the behavioral sciences (second edition). Lawrence Erlbaum Associates.
   [Google Scholar]
7. Cotton, F., & Conrow, F.
   (1998) An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. InS. Wood (Ed.), IELTS Research Reports (Vol.11). ELICOS.
   [Google Scholar]
8. Council of Europe
   Council of Europe (2001) Common European Framework of Reference for Languages: Learning, teaching, assessment. Strasbourg, France: Council of Europe.
   [Google Scholar]
9. Dąbrowska, E.
   (2012) Different speakers, different grammars. Individual differences in native language attainment. Linguistic Approaches to Bilingualism, 2(3), 219–253. 10.1075/lab.2.3.01dab
   https://doi.org/10.1075/lab.2.3.01dab [Google Scholar]
10. Dąbrowska, E.
    (2019) Experience, aptitude and individual differences in linguistic attainment: A comparison of native and nonnative speakers. Language Learning, 69(1), 72–100. 10.1111/lang.12323
    https://doi.org/10.1111/lang.12323 [Google Scholar]
11. de Koning, B., Loyens, S., Rikers, E., Smeets, G., & van der Molen, H.
    (2012) Generation Psy: Student characteristics and academic achievement in a three-year problem-based learning bachelor program. Learning and Individual Differences, 22(3), 313–323. 10.1016/j.lindif.2012.01.003
    https://doi.org/10.1016/j.lindif.2012.01.003 [Google Scholar]
12. De Moor, A., & Colpaert, T.
    (2019) Taal telt: Taalscreening in het eerste jaar hoger onderwijs om studiesucces te bevorderen. [Language matters: language proficiency screening in the first year of higher education to improve study success]. InD. Berckmoes, P. Bonne, J. Heeren, M. Leuridan, I. Mestdagh & J. Vrijders (Eds.), Taalbeleid en taalondersteuning: Wat werkt? (pp.267–275). Lannoo.
    [Google Scholar]
13. Department of Education and Training
    Department of Education and Training (2008) Education in Flanders. A broad view of the Flemish educational landscape. Brussels: Agency for Educational Communication.
    [Google Scholar]
14. De Wachter, L., & Heeren, J.
    (2013) Een taaltest als signaal. De ontwikkeling en implementatie van een strategische taalvaardigheidstoets aan de KU Leuven. [A language test as a signal: the development and implementation of a strategic language proficiency test at the KU Leuven]. Levende Talen Tijdschrift, 14(1), 19–27.
    [Google Scholar]
15. De Wachter, L., Heeren, J., Marx, S., & Huyghe, S.
    (2013) Taal: een noodzakelijke, maar niet de enige voorwaarde tot studiesucces. De correlatie tussen de resultaten van een taalvaardigheidstoets en de slaagcijfers bij eerstejaarsstudenten aan de KU Leuven. [Language proficiency: A necessary, but not the only precondition for study success. The correlation between language test results and achievement of first-year students at the KU Leuven]. Levende Talen Tijdschrift, 14(4), 28–36.
    [Google Scholar]
16. Deygers, B., Peters, E., & Van Den Branden, K.
    (2017) Checking assumed proficiency: Comparing L1 and L2 performance on a university entrance test. Assessing Writing, 321, 43–56. 10.1016/j.asw.2016.12.005
    https://doi.org/10.1016/j.asw.2016.12.005 [Google Scholar]
17. Deygers, B., Zeidler, B., Vilcu, D., & B., Carlsen, C. H.
    (2018) One framework to unite them all? Use of the CEFR in European university entrance policies, Language Assessment Quarterly, 15(1), 3–15. 10.1080/15434303.2016.1261350
    https://doi.org/10.1080/15434303.2016.1261350 [Google Scholar]
18. Dooey, P., & Oliver, R.
    (2002) An investigation into the predictive validity of the IELTS test as an indicator of future academic success. Prospect, 171, 36–54.
    [Google Scholar]
19. Dunn, P. K. & Smyth, G. K.
    (2018) Generalized linear models with examples in R. Springer. 10.1007/978‑1‑4419‑0118‑7
    https://doi.org/10.1007/978-1-4419-0118-7 [Google Scholar]
20. Elder, C.
    (1993) Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Language Testing, 2(1), 68–85.
    [Google Scholar]
21. Elder, C.
    (2017) Language assessment in higher education. InE. Shohamy, I. Or, & S. May (Eds.), Language testing and assessment. Encyclopedia of language and education (pp.271–286). Springer. 10.1007/978‑3‑319‑02261‑1_35
    https://doi.org/10.1007/978-3-319-02261-1_35 [Google Scholar]
22. Elder, C., Bright, C., & Bennet, S.
    (2007) The role of language proficiency in academic success: Perspectives from a New Zealand university. Melbourne Papers in Language Testing, 12(1), 24–58.
    [Google Scholar]
23. Feast, V.
    (2002) The impact of IELTS scores on performance at university. International Education Journal, 31, 70–85.
    [Google Scholar]
24. Ferguson, G., & White, E.
    (1998) A small-scale study of predictive validity. Melbourne Papers in Language Testing, 7(2), 15–63.
    [Google Scholar]
25. Field, A., Miles, J., & Field, Z.
    (2012) Discovering statistics using R. Sage.
    [Google Scholar]
26. Fonteyne, L., De Fruyt, F., Dewulf, N., Duyck, W., Erauw, K., Goeminne, K., … & Rosseel, Y.
    (2015) Basic mathematics test predicts statistics achievement and overall first year academic success. European Journal of Psychology of Education, 30(1), 95–118. 10.1007/s10212‑014‑0230‑9
    https://doi.org/10.1007/s10212-014-0230-9 [Google Scholar]
27. Fouché, I., Van Dyk, T., & Butler, G.
    (2017) An “enlightening course that empowers first years”?: A holistic assessment of the impact of a first-year academic literacy course. Journal of English for Academic Purposes, 271, 14–30. 10.1016/j.jeap.2017.02.006
    https://doi.org/10.1016/j.jeap.2017.02.006 [Google Scholar]
28. Fox, J.
    (2015) Applied regression analysis and generalized linear models. Sage.
    [Google Scholar]
29. Gagen, T. & Faez, F.
    (2023) The predictive validity of IELTS scores: a meta-analysis. Higher Education Research & Development, 1–16.
    [Google Scholar]
30. Gilin, E., Heeren, J., & De Wachter, L.
    (2021) Een taalvaardigheidstest voor anderstaligen voorgelegd aan leerlingen in het Nederlandstalig middelbaar onderwijs: Een onverwacht effect? [A language proficiency test for non-native speakers presented to students in Dutch-speaking secondary education: An unexpected effect?]. Internationale Neerlandistiek, 59(2), 99–113. 10.5117/IN2021.2.001.GILI
    https://doi.org/10.5117/IN2021.2.001.GILI [Google Scholar]
31. Ginther, A., & Yan, X.
    (2018) Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, policy, and profiles. Language Testing, 35(2), 271–295. 10.1177/0265532217704010
    https://doi.org/10.1177/0265532217704010 [Google Scholar]
32. Glorieux, I., Laurijssen, I., & Sobczyk, O.
    (2015) Studiesucces in het eerste jaar hoger onderwijs in Vlaanderen. Een analyse van de impact van kenmerken van studenten en van opleidingen. [Study success in the first year of higher education in Flanders. An analysis of the impact of the characteristics of students and study programs]. Steunpunt SSL.
    [Google Scholar]
33. Graham, J. G.
    (1987) English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505–521. 10.2307/3586500
    https://doi.org/10.2307/3586500 [Google Scholar]
34. Hamilton, J., Lopes, M., McNamara, T., & Sheridan, E.
    (1993) Rating scales and native speaker performance on a communicatively oriented EAP test. Language Testing, 10(3), 337–353. 10.1177/026553229301000307
    https://doi.org/10.1177/026553229301000307 [Google Scholar]
35. Harrell, F. E., Jr.
    (2024) Hmisc: Harrell Miscellaneous (version 5.1–3). https://CRAN.R-project.org/package=Hmisc
    [Google Scholar]
36. Harsch, C., Ushioda, E., & Ladroue, C.
    (2017) Investigating the predictive validity of TOEFL iBT® test scores and their use in informing policy in a United Kingdom university setting. ETS Research Report Series, 2017(1), 1–80.
    [Google Scholar]
37. Heeren, J.
    (2021) Academic language proficiency as a predictor of academic achievement. A validity argument of a low-stakes post-entry academic reading and vocabulary screening test for first-year university students [Unpublished doctoral dissertation]. KU Leuven.
38. Heeren, J., Deygers, B., Speelman, D., & De Wachter, L.
    (2021c) Halen we de norm? De scores van moedertaalsprekers op een talige toegangstest voor anderstaligen aan de universiteit. [Do we meet the standard? The scores of native speakers on a language proficiency test for non-native speakers at the university]. Levende Talen Tijdschrift, 22(1), 3–13.
    [Google Scholar]
39. Heeren, J., Speelman, D., & De Wachter, L.
    (2021a) A practical academic reading and vocabulary screening test as a predictor of achievement in first-year university students: Implications for test purpose and use. International Journal of Bilingual Education and Bilingualism, 24(10), 1458–1473. 10.1080/13670050.2019.1709411
    https://doi.org/10.1080/13670050.2019.1709411 [Google Scholar]
40. Heeren, J., Speelman, D., & De Wachter, L.
    (2021b) Bepaalt taal wie het haalt? De samenhang tussen een academische taalvaardigheidscreening en het behalen van een bachelordiploma aan de universiteit. [Does language proficiency determine who makes it? The relation between an academic language proficiency screening test and obtaining a Bachelor’s degree at the university]. Tijdschrift voor Hoger Onderwijs, 39(1), 39–54. 10.59532/tvho.v39i1.13379
    https://doi.org/10.59532/tvho.v39i1.13379 [Google Scholar]
41. Heeren, J., Speelman, D., & De Wachter, L.
    (2021d) Post-entry language assessment in higher education: ensuring fairness by including the voice of the test-taker. Collated Papers for the ALTE 7th International Conference, Madrid (pp.45–48). ALTE.
    [Google Scholar]
42. Hill, K., Storch, N., & Lynch, B.
    (1999) A comparison of IELTS and TOEFL as predictors of academic success. InR. Tulloh (Ed.), IELTS research reports21 (pp.53–63). IELTS Australia.
    [Google Scholar]
43. Hulstijn, J. H.
    (2011) Language proficiency in native and nonnative speakers: An agenda for research and suggestions for second-language assessment. Language Assessment Quarterly, 8(3), 229–249. 10.1080/15434303.2011.565844
    https://doi.org/10.1080/15434303.2011.565844 [Google Scholar]
44. Hulstijn, J. H.
    (2015) Language proficiency in native and nonnative speakers: Theory and research. John Benjamins. 10.1075/lllt.41
    https://doi.org/10.1075/lllt.41 [Google Scholar]
45. Hulstijn, J. H.
    (2019) An individual-differences framework for comparing nonnative with native speakers: Perspectives from BLC theory. Language Learning, 691, 157–183. 10.1111/lang.12317
    https://doi.org/10.1111/lang.12317 [Google Scholar]
46. Hyland, K.
    (2006) English for academic purposes. Routledge. 10.4324/9780203006603
    https://doi.org/10.4324/9780203006603 [Google Scholar]
47. Hyland, K.
    (2016) General and specific EAP. InK. Hyland & P. Shaw (Eds.). The Routledge handbook of English for academic purposes (pp.17–29). Routledge. 10.4324/9781315657455
    https://doi.org/10.4324/9781315657455 [Google Scholar]
48. Ihlenfeldt, S. D., & Rios, J. A.
    (2023) A meta-analysis on the predictive validity of English language proficiency assessments for college admissions. Language Testing, 40(2), 276–299. 10.1177/02655322221112364
    https://doi.org/10.1177/02655322221112364 [Google Scholar]
49. Interuniversity Testing Consortium
    Interuniversity Testing Consortium (2020) Testonderdelen: B2 [Test components: B2], retrieved fromwww.itna.beon28 January 2020.
    [Google Scholar]
50. Johnson, D. C.
    (1977) The TOEFL and domestic students: Conclusively inappropriate. TESOL Quarterly, 11(1), 79–86. 10.2307/3585594
    https://doi.org/10.2307/3585594 [Google Scholar]
51. Kerstjens, K., & Nery, C.
    (2000) Predictive validity in the IELTS test. InR. Tulloh (Ed.), IELTS research reports (Vol.31) (pp.85–108). IELTS.
    [Google Scholar]
52. Kidd, E., Donnely, S., & Christiansen, M. H.
    (2018) Individual differences in language acquisition and processing. Trends in Cognitive Sciences, 22(2), 154–169. 10.1016/j.tics.2017.11.006
    https://doi.org/10.1016/j.tics.2017.11.006 [Google Scholar]
53. Knoch, U., & Elder, C.
    (2013) A framework for validating post-entry language assessments (PELAs). Papers in Language Testing and Assessment, 2(2), pp. 48–66. 10.58379/YZLQ8816
    https://doi.org/10.58379/YZLQ8816 [Google Scholar]
54. Krausz, J., Schiff, A., Schiff, J., Hise, J. V.
    (2005) The impact of TOEFL scores on placement and performance of international students in the initial graduate accounting class. Accounting Education, 14(1), 103–111. 10.1080/0963928042000256671
    https://doi.org/10.1080/0963928042000256671 [Google Scholar]
55. Kuiken, F., & Vedder, I.
    (2021) The interplay between academic writing abilities of Dutch undergraduate students, a remedial writing programme, and academic achievement. International Journal of Bilingual Education and Bilingualism, 24(10), 1474–1485. 10.1080/13670050.2020.1726280
    https://doi.org/10.1080/13670050.2020.1726280 [Google Scholar]
56. KU Leuven
    KU Leuven (2021) Cumulative study efficiency (CSE). https://www.kuleuven.be/english/education/student/academicprogress/cse
    [Google Scholar]
57. Lacante, M., De Metsenaere, M., Lens, W., Van Esbroeck, R., De Jaeger, K., De Conick, T., … & Santy, L.
    (2001) Drop-out in het hoger onderwijs: Onderzoek naar de achtergronden en motieven van drop-out in het eerste jaar hoger onderwijs. [Drop out in higher education: Research into the backgrounds and motives of drop out in higher education]. Vrije Universiteit Brussel/ Katholieke Universiteit Leuven.
    [Google Scholar]
58. Lee, Y. J., & Greene, J.
    (2007) The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1(4), 366–389. 10.1177/1558689807306148
    https://doi.org/10.1177/1558689807306148 [Google Scholar]
59. McNamara, T., & Ryan, K.
    (2011) Fairness versus justice in language testing: The place of English literacy in the Australian Citizenship Test. Language Assessment Quarterly, 8(2), 161–178. 10.1080/15434303.2011.565438
    https://doi.org/10.1080/15434303.2011.565438 [Google Scholar]
60. Milton, J., & Treffers-Daller, J.
    (2013) Vocabulary size revisited: the link between vocabulary size and academic achievement. Applied Linguistics Review, 4(1), 151–172. 10.1515/applirev‑2013‑0007
    https://doi.org/10.1515/applirev-2013-0007 [Google Scholar]
61. Mol, S. E., & Bus, A. G.
    (2011) To read or not to read: a meta-analysis of print exposure from infancy to early adulthood. Psychological Bulletin, 137(2), 267–96. 10.1037/a0021890
    https://doi.org/10.1037/a0021890 [Google Scholar]
62. Mulder, K., & Hulstijn, J. H.
    (2011) Linguistic skills of adult native speakers as a function of age and level of education. Applied Linguistics, 32(5), 475–494. 10.1093/applin/amr016
    https://doi.org/10.1093/applin/amr016 [Google Scholar]
63. O’Dwyer, J., Kantarcıoğlu, E., & Thomas, C.
    (2018) An investigation of the predictive validity of the TOEFL iBT® test at an English-medium university in Turkey. ETS Research Report Series, 2018(1), 1–13. 10.1002/ets2.12230
    https://doi.org/10.1002/ets2.12230 [Google Scholar]
64. Peters, E., Van Houtven, T., & El Morabit, Z.
    (2010) Is meten echt meer weten? Taalvaardigheid van instromende studenten in het hoger onderwijs in kaart gebracht. [Is to measure really to know? Charting the language proficiency of incoming students in higher education]. InE. Peters & T. Van Houtven (red.), Taalbeleid in het hoger onderwijs: de hype voorbij? (pp.51–66). Acco.
    [Google Scholar]
65. R Core Team
    R Core Team (2020) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.
    [Google Scholar]
66. Read, J.
    (2000) Assessing Vocabulary. Cambridge University Press. 10.1017/CBO9780511732942
    https://doi.org/10.1017/CBO9780511732942 [Google Scholar]
67. Read, J.
    (2015) Assessing English proficiency for university study. Palgrave Macmillan. 10.1057/9781137315694
    https://doi.org/10.1057/9781137315694 [Google Scholar]
68. Read, J.
    (2016) Some key issues in post-admission language assessment. InJ. Read (Ed.), Post-admission language assessment (pp.3–20). Springer. 10.1007/978‑3‑319‑39192‑2_1
    https://doi.org/10.1007/978-3-319-39192-2_1 [Google Scholar]
69. Richardson, M., Abraham, C., & Bond, R.
    (2012) Psychological correlates of university students’ academic performance: a systematic review and meta-analysis. Psychological Bulletin, 138(2), 353. 10.1037/a0026838
    https://doi.org/10.1037/a0026838 [Google Scholar]
70. Rizopoulos, D.
    (2006) ltm: An R package for latent variable modelling and item response theory analyses, Journal of Statistical Software, 17(5), 1–25. 10.18637/jss.v017.i05
    https://doi.org/10.18637/jss.v017.i05 [Google Scholar]
71. Schleppegrell, M. J.
    (2001) Linguistic features of the language of schooling. Linguistics and Education, 12(4), 431–459. 10.1016/S0898‑5898(01)00073‑0
    https://doi.org/10.1016/S0898-5898(01)00073-0 [Google Scholar]
72. Schoepp, K.
    (2018) Predictive validity of the IELTS in an English as a medium of instruction environment. Higher Education Quarterly, 72(4), 271–285. 10.1111/hequ.12163
    https://doi.org/10.1111/hequ.12163 [Google Scholar]
73. Sirin, S. R.
    (2005) Socioeconomic status and academic achievement: a meta-analytic review of research. Review of Educational Research, 75(3), 417–453. 10.3102/00346543075003417
    https://doi.org/10.3102/00346543075003417 [Google Scholar]
74. Snow, C. E.
    (2010) Academic language and the challenge of reading for learning about science. Science, 3281, 450–452. 10.1126/science.1182597
    https://doi.org/10.1126/science.1182597 [Google Scholar]
75. Stricker, L. J.
    (2004) The performance of native speakers of English and ESL speakers on the computer-based TOEFL and GRE General Test. Language Testing, 21(2), 146–173. 10.1191/0265532204lt279oa
    https://doi.org/10.1191/0265532204lt279oa [Google Scholar]
76. Trenkic, D., & Warmington, M.
    (2019) Language and literacy skills of home and international university students: How different are they, and does it matter?Bilingualism: Language and Cognition, 22(2), 349–365. 10.1017/S136672891700075X
    https://doi.org/10.1017/S136672891700075X [Google Scholar]
77. Vandervieren, E., & Casteleyn, J.
    (2020) De relatie tussen taalcompetentie, numerieke geletterdheid en academisch studiesucces: Een verkennende studie. [The relation between language proficiency, numeric literacy and academic achievement: an exploratory study]. Pedagogische Studiën, 97(2), 76–95.
    [Google Scholar]
78. Van Dyk, T.
    (2015) Tried and tested: Academic literacy tests as predictors of academic success. Tijdschrift voor Taalbeheersing, 37(2), 159–186. 10.5117/TVT2015.2.VAND
    https://doi.org/10.5117/TVT2015.2.VAND [Google Scholar]
79. Van Houtven, T., Peters, E., & El Morabit, Z.
    (2010) Hoe staat het met de taal van studenten? Exploratieve studie naar begrijpend lezen en samenvatten bij instromende studenten in het Vlaamse hoger onderwijs. [What is the state of students’ language proficiency? An explorative study into reading comprehension and summary writing in starting students in Flemish higher education]. Levende Talen Tijdschrift, 11(3), 29–44.
    [Google Scholar]
80. van Kalsbeek, A., & Kuiken, F.
    (2014) Academisch taalgebruik in het Nederlandse wetenschappelijk onderwijs: Stand van zaken en blik op de toekomst. [Academic language use in Dutch scientific education: state of affairs and future developments]. Internationale Neerlandistiek, 52(3), 221–236. 10.5117/IN2014.3.KALS
    https://doi.org/10.5117/IN2014.3.KALS [Google Scholar]
81. van Rooij, E., Brouwer, J., Fokkens-Bruinsma, M., Jansen, E., Donche, V., & Noyens, D.
    (2017) A systematic review of factors related to first-year students’ success in Dutch and Flemish higher education. Pedagogische Studiën, 94(5), 360–405.
    [Google Scholar]
82. Van Soom, C., & Donche, V.
    (2014) Profiling first-year students in STEM programs based on autonomous motivation and academic self-concept and relationship with academic achievement. PloS one, 9(11), e112489. 10.1371/journal.pone.0112489
    https://doi.org/10.1371/journal.pone.0112489 [Google Scholar]
83. Verlinde, S., & Peeters, G.
    (2012) Data access revisited: The Interactive Language Toolbox. InS. Granger & M. Paquot (Eds.), Electronic lexicography. Oxford university press. 10.1093/acprof:oso/9780199654864.003.0008
    https://doi.org/10.1093/acprof:oso/9780199654864.003.0008 [Google Scholar]
84. Vinke, A. A., & Jochems, W. M. G.
    (1993) English proficiency and academic success in international postgraduate education. Higher education, 26(3), 275–285. 10.1007/BF01383487
    https://doi.org/10.1007/BF01383487 [Google Scholar]
85. Weir, C. J.
    (2005) Language testing and validation. Palgrave McMillan. 10.1057/9780230514577
    https://doi.org/10.1057/9780230514577 [Google Scholar]
86. Willems, J., Noyens, D., Coertjens, L., Van Petegem, P., & Donche, V.
    (2018) Studiesucces voorspellen in het eerste jaar hoger onderwijs: een kwestie van wikken en wegen? [Predicting achievement in the first year of higher education: a matter of careful consideration?] InF. Glastra, & D. van Middelkoop (Eds.), Studiesucces in het hoger onderwijs: Van rendement naar maatschappelijke relevantie. Edubron.
    [Google Scholar]