1887
Volume 34, Issue 1
  • ISSN 0155-0640
  • E-ISSN: 1833-7139

Abstract

The study reported here investigates the predictive validity of language assessments by ‘Direct Entry’ programs at an Australian University – programs developed on site for Non English Speaking Background international students, principally to provide (i) pre-entry academic and language preparation and (ii) language assessment for university admissions purposes. All 138 students in the sample had entered degree studies via one of the three programs that made up the locally-developed Direct Entry pathway. Inferential statistics (correlation and regression) showed the assessments awarded by two programs to satisfactorily predict academic outcomes, while predictive validity for one was not demonstrated. Descriptive statistics (mean pass rates and academic averages) then revealed a pattern of relatively poor academic performance in certain university disciplines to which particular Direct Entry programs were dedicated. Informed by principles of language program evaluation, the study’s outcomes were seen as both summative and formative: remedial strategies are accordingly recommended. While the specific relevance of the study’s findings is to the particular institutional context in which the study was conducted, the study instantiates a perspective on language assessment validation of broader relevance in an Australian context where locally-developed Direct Entry programs – about which the research literature is largely silent – are increasingly widespread.

Loading

Article metrics loading...

/content/journals/10.1075/aral.34.1.03cop
2011-01-01
2025-02-15
Loading full text...

Full text loading...

References

  1. Alderson, J. , Clapham, C. & Wall, D.
    (1995) Language test construction and evaluation. Cambridge: CUP.
    [Google Scholar]
  2. Bachman, L.
    (1990) Fundamental considerations in language testing. Oxford: OUP.
    [Google Scholar]
  3. Bellingham, L.
    (1993) The relationship of language proficiency to academic success of international students. New Zealand Journal of Educational Studies, 30(2), 229–232.
    [Google Scholar]
  4. Black, J.
    (1991) Performance in English skills courses and overall academic achievement. TESL Canada Journal, 9(1), 42–53. doi: 10.18806/tesl.v9i1.595
    https://doi.org/10.18806/tesl.v9i1.595 [Google Scholar]
  5. Burns, R.
    (1997) Introduction to research methods. Melbourne: Longman.
    [Google Scholar]
  6. Cotton, F. & Conrow, F.
    (1995) An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania. IELTS Research Reports (Vol.1). Canberra: IELTS Australia.
    [Google Scholar]
  7. Dooey, P. & Oliver, R.
    (2002) An investigation into the predictive validity of the IELTS test as an indicator of future academic success. Prospect, 17(1), 36–54.
    [Google Scholar]
  8. Elder, C.
    (1993) Language proficiency as a predictor of performance in teacher education. Melbourne Papers in Applied Linguistics, 2(1), 68–85.
    [Google Scholar]
  9. Feast, V.
    (2002) The impact of IELTS scores on performance at university. International Education Journal, 3(4), 70–85.
    [Google Scholar]
  10. Ferguson, G. & White, E.
    (1998) A predictive study of IELTS. Institute for Applied Language Studies, University of Edinburgh.
    [Google Scholar]
  11. Graham, J.
    (1987) English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505–521. doi: 10.2307/3586500
    https://doi.org/10.2307/3586500 [Google Scholar]
  12. Hale, G. , Stansfield, C. & Duran, R.
    (1984) Summaries of studies involving the Test of English as a Foreign Language, 1963—1982 (Report no. RR-84-03, TOEFL-RR-16). Princeton, N. J.: Educational Testing Service.
    [Google Scholar]
  13. Hill, K. , Storch, N. & Lynch, B.
    (1999) A comparison of IELTS and TOEFL as predictors of academic performance. IELTS Research Reports (Vol.2). Canberra: IELTS Australia.
    [Google Scholar]
  14. Huong, T.
    (2001) The predictive validity of the International English Language Testing System (IELTS) test. Post-Script, 2(1), 66–94.
    [Google Scholar]
  15. Ingram, D. & Bayliss, A.
    (2007) IELTS as a predictor of academic language performance, Part 1. IELTS Research Reports (Vol.7). Canberra: IELTS Australia.
    [Google Scholar]
  16. Kerstjens, M. & Nery, C.
    (2000) Predictive validity in the IELTS test: A study of the relationship between IELTS scores and students’ subsequent academic performance. IELTS Research Reports (Vol.3). Canberra: IELTS Australia.
    [Google Scholar]
  17. Lynch, B.
    (1996) Language program evaluation: Theory and practice. Cambridge: Cambridge University Press.
    [Google Scholar]
  18. Lynch, T.
    (1994) The University of Edinburgh Test of English at Matriculation: Validation report. Edinburgh Working Papers in Applied Linguistics, No.5. Scotland: Edinburgh University.
    [Google Scholar]
  19. (2000) An evaluation of the revised Test of English at Matriculation at the University of Edinburgh. Edinburgh Working Papers in Applied Linguistics, 10, 61–71.
    [Google Scholar]
  20. Macquarie University
    Macquarie University (2002) Macquarie University handbook of undergraduate studies. Sydney: Macquarie University.
    [Google Scholar]
  21. McGovern, P. & Walsh, S.
    (Eds.) (2007) IELTS research reports (Vol.7). Canberra: IELTS Australia.
    [Google Scholar]
  22. Tulloh, R.
    (Ed.) (1999) IELTS research reports (Vol.2). Canberra: IELTS Australia.
    [Google Scholar]
  23. (Ed.) (2000) IELTS research reports (Vol.3). Canberra: IELTS Australia.
    [Google Scholar]
  24. Wood, S.
    (Ed.) (1998) IELTS research reports (Vol.1). Sydney: ELICOS Association.
    [Google Scholar]
  25. Woodrow, L.
    (2006) Academic success of international postgraduate education students and the role of English proficiency. University of Sydney Papers in TESOL, 1, 51–70.
    [Google Scholar]
/content/journals/10.1075/aral.34.1.03cop
Loading
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error