1887
Volume 168, Issue 1
  • ISSN 0019-0829
  • E-ISSN: 1783-1490
USD
Buy:$35.00 + Taxes

Abstract

Statistics play an important role in analyzing data in applied linguistics research. Given the increase over time in the field’s reliance on quantitative analysis ( Brown, 2004 ; Gass, 2009 ), statistical literacy is critical for both producers and consumers of L2 research. Although there has been some investigation into statistical literacy among applied linguists, no research to date has examined how such literacy is obtained by masters and doctoral students in the field. The present study investigated the development of statistical literacy in a sample of such students taking semester-long discipline-specific quantitative research methods courses. Participants completed a pre-course and post-course survey. The results indicate that participants increased their knowledge of basic descriptive statistics and common inferential statistics to a great extent. Furthermore, participants reported that they felt more confident interpreting and using statistics. Based on these findings, recommendations for improving methodological practices and graduate training in our field are provided.

Loading

Article metrics loading...

/content/journals/10.1075/itl.168.1.01gon
2017-09-22
2025-02-12
Loading full text...

Full text loading...

References

  1. Bangert, A. W. , & Baumberger, J. P.
    (2005) Research and statistical techniques used in the Journal of Counseling & Development. Journal of Counseling & Development, 83, 480–487. doi: 10.1002/j.1556‑6678.2005.tb00369.x
    https://doi.org/10.1002/j.1556-6678.2005.tb00369.x [Google Scholar]
  2. Brown, J. D.
    (2004) Resources on quantitative/statistical research for applied linguists. Second Language Research, 20(4), 372–393. doi: 10.1191/0267658304sr245ra
    https://doi.org/10.1191/0267658304sr245ra [Google Scholar]
  3. (2015) Why bother learning advanced quantitative methods in L2 research. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp.9–20). New York, NY: Routledge.
    [Google Scholar]
  4. Chaudron, C.
    (2001) Progress in language classroom research: Evidence from The Modern Language Journal, 1916–2000. Modern Language Journal, 85, 57–76. doi: 10.1111/0026‑7902.00097
    https://doi.org/10.1111/0026-7902.00097 [Google Scholar]
  5. Cunnings, I.
    (2012) An overview of mixed-effects statistical models for second language researchers. Second Language Research, 28(3), 369–382. doi: 10.1177/0267658312443651
    https://doi.org/10.1177/0267658312443651 [Google Scholar]
  6. De Bot, K.
    (2015) A history of applied linguistics: From 1980 to the present. London: Routledge.
    [Google Scholar]
  7. Field, A.
    (2013) Discovering statistics using IBM SPSS statistics. Thousand Oaks, CA: Sage.
    [Google Scholar]
  8. Finney, S. , & Schraw, G.
    (2003) Self-efficacy beliefs in college statistics courses. Contemporary Educational Psychology, 28, 161–186. doi: 10.1016/S0361‑476X(02)00015‑2.
    https://doi.org/10.1016/S0361-476X(02)00015-2 [Google Scholar]
  9. Gal, I.
    (2002) Adults’ statistical literacy: Meanings, components, responsibilities. International Statistical Review, 70(1), 1–25. doi: 10.2307/1403713.
    https://doi.org/10.2307/1403713 [Google Scholar]
  10. Gass, S.
    (2009) A survey of SLA research. In W. Ritchie , & T. Bhatia (Eds.), Handbook of second language acquisition (pp.3–28). Bingley: Emerald.
    [Google Scholar]
  11. Gass, S. , Fleck, C. , Leder, N. , & Svetics, I.
    (1998) Ahistoricity revisited. Studies in Second Language Acquisition, 20(03), 407–421. doi: org.proxy2.cl.msu.edu/
    https://doi.org/org.proxy2.cl.msu.edu/ [Google Scholar]
  12. Godfroid, A. , & Spino, L. A.
    (2015) Reconceptualizing reactivity of think-alouds and eye tracking: Absence of evidence is not evidence of absence. Language Learning, 65(4). doi: 10.1111/lang.12136
    https://doi.org/10.1111/lang.12136 [Google Scholar]
  13. Gonulal, T.
    (2016) Statistical literacy among second language acquisition graduate students. Unpublished doctoral dissertation, Michigan State University, East Lansing, MI.
    [Google Scholar]
  14. Henson, R. K. , Hull, D. M. , & Williams, C. S.
    (2010) Methodology in our education research culture toward a stronger collective quantitative proficiency. Educational Researcher, 39(3), 229–240. doi: 10.3102/0013189X10365102
    https://doi.org/10.3102/0013189X10365102 [Google Scholar]
  15. Larson-Hall, J.
    (2010) A guide to doing statistics in second language research usingSPSS. New York, NY: Routledge.
    [Google Scholar]
  16. Larson-Hall, J. , & Herrington, R.
    (2010) Improving data analysis in second language acquisition by utilizing modern developments in applied statistics. Applied Linguistics, 31(3), 368–390. doi: 10.1093/applin/amp038
    https://doi.org/10.1093/applin/amp038 [Google Scholar]
  17. Larson-Hall, J. , & Plonsky, L.
    (2015) Reporting and interpreting quantitative research findings: What gets reported and recommendations for the field. Language Learning, 65(S1), 127–159. doi: 10.1111/lang.12115
    https://doi.org/10.1111/lang.12115 [Google Scholar]
  18. Lazaraton, A.
    (2000) Current trends in research methodology and statistics in applied linguistics. TESOL Quarterly, 34, 175–181. doi: 10.2307/3588103
    https://doi.org/10.2307/3588103 [Google Scholar]
  19. (2005) Quantitative research methods. In E. Hinkel (Ed.), Handbook of research in second language teaching and learning (pp.109–224). Mahwah, NJ: Lawrence Erlbaum Associates.
    [Google Scholar]
  20. Lazaraton, A. , Riggenbach, H. , & Ediger, A.
    (1987) Forming a discipline: Applied linguists’ literacy in research methodology and statistics. TESOL Quarterly, 21(2), 263–277. doi: 10.2307/3586735
    https://doi.org/10.2307/3586735 [Google Scholar]
  21. Lindstromberg, S.
    (2016) Inferential statistics in Language Teaching Research: A review and ways forward. Language Teaching Research, 20(6), 741–768. doi: 10.1177/1362168816649979
    https://doi.org/10.1177/1362168816649979 [Google Scholar]
  22. Loewen, S. , & Gass, S.
    (2009) Research timeline: The use of statistics in L2 acquisition research. Language Teaching, 42(2), 181–196. doi: 10.1017/S0261444808005624
    https://doi.org/10.1017/S0261444808005624 [Google Scholar]
  23. Loewen, S. , & Gonulal, T.
    (2015) Exploratory factor analysis and principal components analysis. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp.182–212). New York, NY: Routledge.
    [Google Scholar]
  24. Loewen, S. , Lavolette, E. , Spino, L. A. , Papi, M. , Schmidtke, J. , Sterling, S. , & Wolff, D.
    (2014) Statistical literacy among applied linguists and second language acquisition researchers. TESOL Quarterly, 48(2), 360–388. doi: 10.1002/tesq.128
    https://doi.org/10.1002/tesq.128 [Google Scholar]
  25. Loewen, S. , & Plonsky, L.
    (2015) An A-Z of applied linguistics research methods. New York, NY: Palgrave.
    [Google Scholar]
  26. Lowie, W. , & Seton, B.
    (2012) Essential statistics for applied linguistics. Houndmills: Palgrave Macmillan.
    [Google Scholar]
  27. Mahboob, A. , Paltridge, B. , Phakiti, A. , Wagner, E. , Starfield, S. , Burns, A. , Jones, R. H. , & De Costa, P. I.
    (2016)  TESOL Quarterly research guidelines. TESOL Quarterly, 50, 42–65. doi: 10.1002/tesq.288
    https://doi.org/10.1002/tesq.288 [Google Scholar]
  28. Norris, J. M.
    (2015) Statistical significance testing in second language research: Basic problems and suggestions for reform. Language Learning, 65(S1), 97–126. doi: 10.1111/lang.12114
    https://doi.org/10.1111/lang.12114 [Google Scholar]
  29. Norris, J. M. , Ross, S. J. , & Schoonen, R.
    (2015) Improving second language quantitative research. Language Learning, 65(S1), 1–8. doi: 10.1111/lang.12110
    https://doi.org/10.1111/lang.12110 [Google Scholar]
  30. Norris, J. M. , Plonsky, L. , Ross, S. J. , & Schoonen, R.
    (2015) Guidelines for reporting quantitative methods and results in primary research. Language Learning, 65(2), 470–476. doi: 10.1111/lang.12104
    https://doi.org/10.1111/lang.12104 [Google Scholar]
  31. Paquot, M. , & Plonsky, L.
    (2017) Quantitative research methods and study quality in learner corpus research. International Journal of Learner Corpus Research, 3(1), 61–94. doi: 10.1075/ijlcr.3.1.03paq
    https://doi.org/10.1075/ijlcr.3.1.03paq [Google Scholar]
  32. Plonsky, L.
    (2011) Study quality in SLA: A cumulative and developmental assessment of designs, analyses, reporting practices, and outcomes in quantitative L2 research (Unpublished doctoral dissertation). Michigan State University, East Lansing, MI.
    [Google Scholar]
  33. (2013) Study quality in SLA: An assessment of designs, analyses, and reporting practices in quantitative L2 research. Studies in Second Language Acquisition, 35, 655–687. doi: 10.1017/S0272263113000399
    https://doi.org/10.1017/S0272263113000399 [Google Scholar]
  34. (Ed.) (2015a) Advancing quantitative methods in second language research. New York, NY: Routledge.
    [Google Scholar]
  35. (2015b) Quantitative considerations for improving replicability in CALL and applied linguistics. CALICO Journal, 32(2), 232–244. doi: 10.1558/cj.v32i2.26857
    https://doi.org/10.1558/cj.v32i2.26857 [Google Scholar]
  36. (2015c) Statistical power, p values, descriptive statistics, and effect sizes: A “back-to-basics” approach to advancing quantitative methods in L2 research. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp.23–45). New York, NY: Routledge.
    [Google Scholar]
  37. Plonsky, L. , & Derrick, D. J.
    (2016) A meta-analysis of reliability coefficients in second language research. Modern Language Journal, 100, 538–553. doi: 10.1111/modl.12335
    https://doi.org/10.1111/modl.12335 [Google Scholar]
  38. Plonsky, L. , Egbert, J. , & LaFlair, G. T.
    (2014) Bootstrapping in applied linguistics: Assessing its potential using shared data. Applied Linguistics, 1–21. doi: 10.1093/applin/amu001
    https://doi.org/10.1093/applin/amu001 [Google Scholar]
  39. Plonsky, L. , & Gass, S.
    (2011) Quantitative research methods, study quality, and outcomes: The case of interaction research. Language Learning, 61(2), 325–366. doi: 10.1111/j.1467‑9922.2011.00640.x
    https://doi.org/10.1111/j.1467-9922.2011.00640.x [Google Scholar]
  40. Plonsky, L. , & Gonulal, T.
    (2015) Methodological synthesis in quantitative L2 research: A review of reviews and a case study of exploratory factor analysis. Language Learning, 65(S1), 9–36. doi: 10.1111/lang.12111
    https://doi.org/10.1111/lang.12111 [Google Scholar]
  41. Plonsky, L. , & Oswald, F. L.
    (2016) Multiple regression as a flexible alternative to ANOVA in L2 research. Studies in Second Language Acquisition, 1–14. doi: 10.1017/S0272263116000231
    https://doi.org/10.1017/S0272263116000231 [Google Scholar]
  42. Teleni, V. , & Baldauf, R. B.
    (1989) Statistical techniques used in three applied linguistics journals: Language Learning, Applied Linguistics, and TESOL Quarterly, 1980–1986: Implications for readers and researchers. Unpublished research report. (ERIC Document Reproduction Service No. ED312905).
    [Google Scholar]
  43. Wallman, K. K.
    (1993) Enhancing statistical literacy: Enriching our society. Journal of the American Statistical Association, 88(421), 1–8.
    [Google Scholar]
  44. Wilkinson, L.
    (1999) Statistical methods in psychology journals: Guidelines and explanations. American psychologist, 54(8), 594–604. doi: 10.1037/0003‑066X.54.8.594
    https://doi.org/10.1037/0003-066X.54.8.594 [Google Scholar]
  45. Winke, P.
    (2014) Testing hypotheses about language learning using structural equation modeling. Annual Review of Applied Linguistics, 34, 102–122. doi: 10.1017/S0267190514000075
    https://doi.org/10.1017/S0267190514000075 [Google Scholar]
/content/journals/10.1075/itl.168.1.01gon
Loading
/content/journals/10.1075/itl.168.1.01gon
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): L2 research; quantitative research methods; statistical literacy
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error