1887
  1. Home
  2. e-Journals
  3. ITL - International Journal of Applied Linguistics
  4. Volume 172, Issue 1
  5. Article
Volume 172, Issue 1
  • ISSN 0019-0829
  • E-ISSN: 1783-1490
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Despite an abundance of studies that address the fundamental issue of the relationship between students’ IELTS results and their academic performance, findings remain inconclusive. One reason for this are variations in research design, notably in how researchers collect, analyse, and interpret data, and report their findings. The present study constitutes a critical methodological synthesis of 32 published IELTS predictive validity studies. The results revealed a number of efficacious design practices, and also some concerning tendencies, including: (a) dependency on linear models of causality, (b) small sampling frames situated in Anglo-Australian contexts, (c) a lack of thoroughness in describing contexts, samples, and approaches to academic performance measurement, and (d) where qualitative data was generated through interviewing and observation, a tendency to overlook ‘quality’ issues, such as confirmability, dependability, and trustworthiness. Recommendations are made for enhancing research designs along with suggestions for novel investigations to address gaps in the predictive validity literature.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/itl.19021.pea
2020-04-14
2023-02-07

  • From This Site

    /content/journals/10.1075/itl.19021.pea
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. * Al-Malki, M. A. S.
    (2014) Testing the predictive validity of the IELTS test on Omani English candidates’ professional competencies. International Journal of Applied Linguistics & English Literature, 3(5), 166–172. doi:  10.7575/aiac.ijalel.v.3n.5p.166
     https://doi.org/10.7575/aiac.ijalel.v.3n.5p.166 [Google Scholar]
  2. * Arcuino, C. L. T.
    (2013) The relationship between the Test of English as a Foreign Language (TOEFL), the International English Language Testing System (IELTS) scores and academic success of international Master’s students [Colorado State University]. https://search.proquest.com/pqdtglobal/docview/1413309058/B381BA5B035948FCPQ/5?accountid=10792
     [Google Scholar]
  3. * Arrigoni, E. , & Clark, V.
    (2015) Investigating the appropriateness of IELTS cut-off scores for admissions and placement decisions at an English-medium university in Egypt (IELTS Research Report Series, No. 3). IELTS Partners: British Council, Cambridge English Language Assessment and IDP: IELTS Australia. https://www.ielts.org/-/media/research-reports/ielts_online_rr_2015-3.ashx
     [Google Scholar]
  4. Bachman, L. F.
    (1990) Fundamental considerations in language testing. Oxford University Press.
     [Google Scholar]
  5. * Bellingham, L.
    (1993) The relationship of language proficiency to academic success for international students. New Zealand Journal of Educational Studies, 30(2), 229–232.
     [Google Scholar]
  6. (1995) Navigating choppy seas: IELTS as a support for success in higher education. The TESOLANZ Journal, 3, 21–28. www.tesolanz.org.nz/Site/Publications/TESOLANZ_Journal/TESOLANZ_Journal_Volume_03_1995.aspx
     [Google Scholar]
  7. * Breeze, R. , & Miller, P.
    (2011) Predictive validity of the IELTS Listening Test as an indicator of student coping ability in Spain (IELTS Research Reports, Volume 12). IDP: IELTS Australia and British Council. https://www.ielts.org/-/media/research-reports/ielts_rr_volume12_report5.ashx
     [Google Scholar]
  8. Coleman, D. , Starfield, S. , & Hagan, A.
    (2003) The attitudes of IELTS stakeholders: Student and staff perceptions of IELTS in Australian, UK and Chinese tertiary institutions (IELTS Research Reports, Volume 5). IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume05_report4.ashx
     [Google Scholar]
  9. * Cooper, T.
    (2013) Can IELTS writing scores predict university performance? Comparing the use of lexical bundles in IELTS writing tests and first-year academic writing. Stellenbosch Papers in Linguistics Plus, 42, 63–79. doi:  10.5842/42‑0‑155
     https://doi.org/10.5842/42-0-155 [Google Scholar]
  10. * Cotton, F. , & Conrow, F.
    (1998) An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania (IELTS Research Reports, Volume 1). IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume01_report4.ashx
     [Google Scholar]
  11. Criper, C. , & Davies, A.
    (1988) ELTS validation report. University of Cambridge Local Examinations Syndicate.
     [Google Scholar]
  12. * Daller, M. H. , & Phelan, D.
    (2013) Predicting international student study success. Applied Linguistics Review, 4(1), 173–193. doi:  10.1515/applirev‑2013‑0008
     https://doi.org/10.1515/applirev-2013-0008 [Google Scholar]
  13. Davies, A.
    (2007) Assessing academic English language proficiency: 40+ years of U.K. language tests. In J. Fox , M. Wesche , D. Bayliss , L. Cheng , C. E. Turner , & C. Doe (Eds.), Language testing reconsidered (pp.73–86). University of Ottawa Press. 10.2307/j.ctt1ckpccf.10
     https://doi.org/10.2307/j.ctt1ckpccf.10 [Google Scholar]
  14. Demirkan-Jones, N.
    (2006) Exploring the importance of “identity” for the East Asian students in an EAP context: A case study (BALEAP PIM Report: The East Asian Learner). BALEAP.
     [Google Scholar]
  15. * Dooey, P. , & Oliver, R.
    (2002) An investigation into the predictive validity of the IELTS test as an indicator of future academic success. Prospect, 17(1), 36–54. www.ameprc.mq.edu.au/docs/prospect_journal/volume_17_no_1/17_1_3_Dooey.pdf
     [Google Scholar]
  16. * Elder, C.
    (1993) Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Language Testing, 2(2), 72–95.
     [Google Scholar]
  17. * Feast, V.
    (2002) The impact of IELTS scores on performance at university. International Education Journal, 3(4), 70–85. www.iejcomparative.org/data/volumes/v3n4.pdf
     [Google Scholar]
  18. * Ferguson, G. , & White, E.
    (1998) A small-scale study of predictive validity. Melbourne Papers in Language Testing, 7(2), 15–63.
     [Google Scholar]
  19. Flowerdew, J.
    (2016) English for specific academic purposes (ESAP) writing: Making the case. Writing & Pedagogy, 8(1), 5–32. doi:  10.1558/wap.v8i1.30051
     https://doi.org/10.1558/wap.v8i1.30051 [Google Scholar]
  20. * Garinger, D. , & Schoepp, K.
    (2013) IELTS and academic achievement: A UAE case study. TESOL Arabia Perspectives, 21(3), 7–14. https://issuu.com/tesolarabia-perspectives/docs/perspectives_nov_2013
     [Google Scholar]
  21. Ginther, A. , & Yan, X.
    (2018) Interpreting the relationships between TOEFL iBT scores and GPA: Language proficiency, policy, and profiles. Language Testing, 35(2), 271–295. doi:  10.1177/0265532217704010
     https://doi.org/10.1177/0265532217704010 [Google Scholar]
  22. Graham, J. G.
    (1987) English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505–521. doi:  10.2307/3586500
     https://doi.org/10.2307/3586500 [Google Scholar]
  23. Green, R.
    (2000) Life after the pre-sessional course: How students fare in their departments. In G. M. Blue , J. Milton , & J. Saville (Eds.), Assessing English for academic purposes (pp.131–145). Peter Lang.
     [Google Scholar]
  24. * Heitner, R. M. , Hoekje, B. J. , & Braciszewski, P. L.
    (2014) Keys to college: Tracking English language proficiency and IELTS test scores in an international undergraduate conditional admission program in the United States. In J. Connor-Linton & L. W. Amoroso (Eds.), Measured language: Quantitative approaches to acquisition, assessment, and variation (pp.183–197). Gorgetown University Press.
     [Google Scholar]
  25. HESA
    HESA (2019) Where do HE students come from?Higher Education Statistics Agency. https://www.hesa.ac.uk/data-and-analysis/students/where-from
     [Google Scholar]
  26. * Hill, K. , Storch, N. , & Lynch, B.
    (1999) A comparison of IELTS and TOEFL as predictors of academic success (IELTS Research Reports, Volume 2). IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume02_report3.ashx
     [Google Scholar]
  27. * Humphreys, P. , Haugh, M. , Fenton-Smith, B. , Lobo, A. , Michael, R. , & Walkinshaw, I.
    (2012) Tracking international students’ English proficiency over the first semester of undergraduate study (IELTS Research Report Series, No. 1). IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_online_rr_2012-1.ashx
     [Google Scholar]
  28. * Huong, T. T. T.
    (2001) The predictive validity of the International English Language Testing System (IELTS) Test. Post-Script, 2(1), 66–96.
     [Google Scholar]
  29. Hyatt, D.
    (2013) Stakeholders’ perceptions of IELTS as an entry requirement for higher education in the UK. Journal of Further and Higher Education, 37(6), 844–863. doi:  10.1080/0309877X.2012.684043
     https://doi.org/10.1080/0309877X.2012.684043 [Google Scholar]
  30. Hyatt, D. , & Brooks, G.
    (2009) Investigating stakeholders’ perceptions of IELTS as an entry requirement for higher education in the UK (IELTS Research Reports, Volume 10). IELTS Australia Pty Limited and British Council. https://www.ielts.org/-/media/research-reports/ielts_rr_volume10_report1.ashx
     [Google Scholar]
  31. Hyland, K.
    (2016) Methods and methodologies in second language writing research. System, 59, 116–125. doi:  10.1016/j.system.2016.05.002
     https://doi.org/10.1016/j.system.2016.05.002 [Google Scholar]
  32. IELTS
    IELTS (2017) IELTS numbers rise to three million a year. https://www.ielts.org/news/2017/ielts-numbers-rise-to-three-million-a-year
     [Google Scholar]
  33. IELTS
    IELTS (2019) Guide for educational institutions, governments, professional bodies and commercial organisations. Cambridge Assessment English, The British Council, IDP Australia. https://www.ielts.org/-/media/publications/guide-for-institutions/ielts-guide-for-institutions-2015-uk.ashx
     [Google Scholar]
  34. * Ingram, D. , & Bayliss, A.
    (2007) IELTS as a predictor of academic language performance, part 1 (IELTS Research Reports, Volume 7). British Council and IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume07_report3.ashx
     [Google Scholar]
  35. Kang, E. , & Han, Z.
    (2015) The efficacy of written corrective feedback in improving L2 written accuracy: A meta-analysis. The Modern Language Journal, 99(1), 1–18. doi:  10.1111/modl.12189
     https://doi.org/10.1111/modl.12189 [Google Scholar]
  36. Karim, K. , & Nassaji, H.
    (2019) The effects of written corrective feedback: A critical synthesis of past and present research. Instructed Second Language Acquisition, 3(1), 28–52. doi:  10.1558/isla.37949
     https://doi.org/10.1558/isla.37949 [Google Scholar]
  37. * Kerstjens, M. , & Nery, C.
    (2000) Predictive validity in the IELTS test: A study of the relationship between IELTS scores and students’ subsequent academic performance (IELTS Research Reports, Volume 3). IELTS Australia Pty Limited. https://www.ielts.org/teaching-and-research/research-reports/volume-03-report-4
     [Google Scholar]
  38. * Khemakhem, S.
    (2016) Investigating the predictive validity of IELTS for a teacher education program in UAE [University of the West of England]. eprints.uwe.ac.uk/28078/
     [Google Scholar]
  39. Larson-Hall, J. , & Plonsky, L.
    (2015) Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65(S1), 127–159. doi:  10.1111/lang.12115
     https://doi.org/10.1111/lang.12115 [Google Scholar]
  40. Li, M. , & Bray, M.
    (2007) Cross-border flows of students for higher education: Push-pull factors and motivations of mainland Chinese students in Hong Kong and Macau. Higher Education, 53, 791–818. doi:  10.1007/s10734‑005‑5423‑3
     https://doi.org/10.1007/s10734-005-5423-3 [Google Scholar]
  41. Liu, Q. , & Brown, D.
    (2015) Methodological synthesis of research on the effectiveness of corrective feedback in L2 writing. Journal of Second Language Writing, 30, 66–81. doi:  10.1016/j.jslw.2015.08.011
     https://doi.org/10.1016/j.jslw.2015.08.011 [Google Scholar]
  42. * Lloyd-Jones, G. , Neame, C. , & Medaney, S.
    (2012) A multiple case study of the relationship between the indicators of students’ English language competence on entry and students’ academic progress at an international postgraduate university (IELTS Research Reports, Volume 11). British Council, Cambridge Assessment English and IDP: IELTS Australia. https://www.ielts.org/-/media/research-reports/ielts_rr_volume11_report3.ashx
     [Google Scholar]
  43. MacDonald, J. J.
    (2019) Sitting at 6.5: Problematizing IELTS and admissions to Canadian universities. TESL Canada Journal, 36(1), 160–171. doi:  10.18806/tesl.v36i1.1308
     https://doi.org/10.18806/tesl.v36i1.1308 [Google Scholar]
  44. Merrifield, G. , & GBM & Associates
    (2016) An impact study into the use of IELTS by professional associations in the United Kingdom, Canada, Australia and New Zealand, 2014 to 2015 (IELTS Research Reports Series, No. 7). British Council, Cambridge English Language Assessment and IDP: IELTS Australia. https://www.ielts.org/-/media/research-reports/ielts_online_rr_2016-7.ashx
     [Google Scholar]
  45. Migration Advisory Committee
    Migration Advisory Committee (2018) Impact of international students in the UK. https://www.gov.uk/government/organisations/migration-advisory-committee
     [Google Scholar]
  46. Müller, A.
    (2015) The differences in error rate and type between IELTS writing bands and their impact on academic workload. Higher Education Research & Development, 34(6), 1207–1219. doi:  10.1080/07294360.2015.1024627
     https://doi.org/10.1080/07294360.2015.1024627 [Google Scholar]
  47. * Müller, A. , & Daller, M.
    (2019) Predicting international students’ clinical and academic grades using two language tests (IELTS and C-test): A correlational research study. Nurse Education Today, 72, 6–11. doi:  10.1016/j.nedt.2018.10.007
     https://doi.org/10.1016/j.nedt.2018.10.007 [Google Scholar]
  48. O’Loughlin, K.
    (2008) The use of IELTS for university selection in Australia: A case study (IELTS Research Reports, Volume 8). IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume08_report3.ashx
     [Google Scholar]
  49. (2011) The interpretation and use of proficiency test scores in university selection: How valid and ethical are they?Language Assessment Quarterly, 8(2), 146–160. doi:  10.1080/15434303.2011.564698
     https://doi.org/10.1080/15434303.2011.564698 [Google Scholar]
  50. (2013) Developing the assessment literacy of university proficiency test users. Language Testing, 30(3), 363–380. doi:  10.1177/0265532213480336
     https://doi.org/10.1177/0265532213480336 [Google Scholar]
  51. OECD
    OECD (2019) Education at a glance 2019: OECD indicators. OECD Pubishing. doi:  10.1787/f6dc8198‑es
     https://doi.org/10.1787/f6dc8198-es [Google Scholar]
  52. * Oliver, R. , Vanderford, S. , & Grote, E.
    (2012) Evidence of English language proficiency and academic achievement of non-English-speaking background students. Higher Education Research & Development, 31(4), 541–555. doi:  10.1080/07294360.2011.653958
     https://doi.org/10.1080/07294360.2011.653958 [Google Scholar]
  53. Parliament of Australia
    Parliament of Australia (2019) Overseas students in Australian higher education: A quick guide. https://www.aph.gov.au/About_Parliament/Parliamentary_Departments/Parliamentary_Library/pubs/rp/rp1819/Quick_Guides/OverseasStudents
     [Google Scholar]
  54. * Paul, A.
    (2007) IELTS as a predictor of academic language performance, part 2 (IELTS Research Reports, Volume 7). British Council and IELTS Australia Pty Limited. https://www.ielts.org/-/media/research-reports/ielts_rr_volume07_report4.ashx
     [Google Scholar]
  55. * Phakiti, A.
    (2008) Predicting NESB international postgraduate students’ academic achievement: A structural equation modeling approach. International Journal of Applied Educational Studies, 3(1), 18–38. www.questia.com/library/journal/1G1-192485746/predicting-nesb-international-postgraduate-students
     [Google Scholar]
  56. Plonsky, L.
    (2013) Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35(4), 655–687. doi:  10.1017/S0272263113000399
     https://doi.org/10.1017/S0272263113000399 [Google Scholar]
  57. (2014) Study quality in quantitative L2 research (1990–2010): A methodological synthesis and call for reform. Modern Language Journal, 98(1), 450–470. doi:  10.1111/j.1540‑4781.2014.12058.x
     https://doi.org/10.1111/j.1540-4781.2014.12058.x [Google Scholar]
  58. Plonsky, L. , Marsden, E. , Crowther, D. , & Spinner, P.
    (2019) A methodological synthesis and meta-analysis of judgment tasks in second language research. Second Language Research, 1–39. doi:  10.1177/0267658319828413
     https://doi.org/10.1177/0267658319828413 [Google Scholar]
  59. Rea-Dickins, P. , Kiely, R. , & Yu, G.
    (2011) Uses and impact of test scores in university admissions processes: The language test as the “hard” criterion. In B. O’Sullivan (Ed.), Language testing: Theories and practices (pp.262–281). Palgrave Macmillan.
     [Google Scholar]
  60. * Schoepp, K.
    (2018) Predictive validity of the IELTS in an English as a medium of instruction environment. Higher Education Quarterly, 72(4), 271–285. doi:  10.1111/hequ.12163
     https://doi.org/10.1111/hequ.12163 [Google Scholar]
  61. Spencer, L. , Ritchie, J. , Lewis, J. , & Dillon, L.
    (2003) Quality in qualitative evaluation: A framework for assessing research evidence: A quality framework. Cabinet Office. https://assets.publishing.service.gov.uk/government/uploads/system/uploads/attachment_data/file/498322/a_quality_framework_tcm6-38740.pdf
     [Google Scholar]
  62. Storch, N. , & Tapper, J.
    (2009) The impact of an EAP course on postgraduate writing. Journal of English for Academic Purposes, 8(3), 207–223. doi:  10.1016/j.jeap.2009.03.001
     https://doi.org/10.1016/j.jeap.2009.03.001 [Google Scholar]
  63. * Thorpe, A. , Snell, M. , Davey-Evans, S. , & Talman, R.
    (2017) Improving the academic performance of non-native English-speaking students: The contribution of pre-sessional English language programmes. Higher Education Quarterly, 71(1), 5–32. doi:  10.1111/hequ.12109
     https://doi.org/10.1111/hequ.12109 [Google Scholar]
  64. * Ushioda, E. , & Harsch, C.
    (2011) Examining the predictive validity of IELTS scores (Addressing the Needs of International Students with Academic Writing Difficulties: Pilot Project 2010/11). University of Warwick. https://warwick.ac.uk/fac/soc/al/research/groups/llta/research/past_projects/strand_2_project_report_public.pdf
     [Google Scholar]
  65. Wächter, B. , & Maiworm, F.
    (2014) English-taught programmes in European higher education: The state of play in 2014 (ACA Papers on International Cooperation in Education). www.aca-secretariat.be/fileadmin/aca_docs/images/members/ACA-2015_English_Taught_01.pdf
     [Google Scholar]
  66. * Wang, Y. , & Daller, M.
    (2014) Predicting Chinese students’ academic achievement in the UK. Learning, Working and Communicating in a Global Context, 217–227. https://baal.org.uk/wp-content/uploads/2016/10/proceedings_2014.pdf
     [Google Scholar]
  67. * Woodrow, L.
    (2006) Academic success of international postgraduate education students and the role of English proficiency. University of Sydney Papers in TESOL, 1(1), 51–70. faculty.edfac.usyd.edu.au/projects/usp_in_tesol/pdf/volume01/article03.pdf
     [Google Scholar]
  68. * Yen, D. A. , & Kuzma, J.
    (2009) Higher IELTS Score, higher academic performance? The validity of IELTS in predicting the academic performance of Chinese students. Worcester Journal of Learning and Teaching, 3, 1–7. eprints.worc.ac.uk/811/1/YenKuzmaIELTScores.pdf
     [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/itl.19021.pea
Loading
The predictive validity of the Academic IELTS test
ITL - International Journal of Applied Linguistics 172, 85 (2021); https://doi.org/10.1075/itl.19021.pea
/content/journals/10.1075/itl.19021.pea
/content/journals/10.1075/itl.19021.pea
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): IELTS; language testing; methodological synthesis; predictive validity

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error