1887
Volume 58, Issue 3
  • ISSN 2451-828x
  • E-ISSN: 2451-8298
USD
Buy:$35.00 + Taxes

Abstract

Abstract

L2 syntactic complexity research has shown that employing multidimensional measures to assess writing proficiency levels may yield more accurate results compared to one-dimensional measures. However, the optimal number and combination of measures have not been thoroughly explored. This study addresses these gaps by employing a novel machine learning-based approach to quantitatively investigate the effectiveness of multidimensional measures and determine the optimal combination of measures. Through the analysis of a dataset comprising 36 L2 Chinese learners, we found that multidimensional syntactic complexity measures outperformed one-dimensional measures in accurately differentiating learners. Specifically, a combination of three measures (Mean Length of Sentence, Mean Length of T-unit, and Mean Length of Clause) achieved the highest accuracy in classifying the learners. The implications of this research include the development of computer-assisted placement tests and proficiency evaluations, as well as providing practical guidance for language teachers in designing complexity-based instruction.

Loading

Article metrics loading...

/content/journals/10.1075/csl.22007.shi
2024-09-06
2025-06-20
Loading full text...

Full text loading...

References

  1. ACTFL
    ACTFL (2012) ACTFL Proficiency Guidelines 2012. ACTFL. https://www.actfl.org/educator-resources/actfl-proficiency-guidelines
    [Google Scholar]
  2. Aydin, S.
    (2009) Test anxiety among foreign language learners: a review of literature. Journal of Language and Linguistic Studies, 5(1), 127–137. 10.17263/jlls.09435
    https://doi.org/10.17263/jlls.09435 [Google Scholar]
  3. Bardovi-Harlig, K.
    (1992) A second look at t-unit analysis: Reconsidering the sentence. TESOL Quarterly, 26(2), 390–395. 10.2307/3587016
    https://doi.org/10.2307/3587016 [Google Scholar]
  4. Chen, M.
    (2015) Hanyu zuowei di’er yuyan ziran kouyu chanchu de fuzadu, zhunquedu he liulidu yanjiu汉语作为第二语言自然口语产出的复杂度, 准确度和流利度研究[A complexity, accuracy and fluency study on natural oral production of Chinese as a second language]. Yuyan jiaoxue yu yanjiu语言教学与研究 [Language Teaching and Linguistic Studies], 31, 1–10.
    [Google Scholar]
  5. Chen, M., & Li, Y.
    (2016) Hanyu muyuzhe Hanyu kouyu fuzadu yanjiu汉语母语者汉语口语复杂度研究 [The complexity of Chinese oral speeches by Korean native speakers]. Yuyan Wenzi Yingyong语言文字应用 [Applied Linguistics], 41, 61–70.
    [Google Scholar]
  6. Halliday, M. A. K., & Matthiessen, C.
    (2006) Construing experience through meaning : A language-based approach to cognition. Continuum.
    [Google Scholar]
  7. Han, X., & Feng, L.
    (2017) Hanyu kouyu jufa fuzadu fazhan zeping zhong jizhunxing zhibiao de yingyong fangfa yanjiu汉语口语句法复杂度发展测评中基准型指标的应用方法研究 [The application method research of benchmark measures in Chinese oral syntactic complexity development assessment]. Shijie Hanyu jiaoxue世界汉语教学 [Chinese Teaching in the World], 31(4), 542–559.
    [Google Scholar]
  8. Hu, R., Wu, J., & Lu, X.
    (2022) Word-combination-based measures of phraseological diversity, sophistication, and complexity and their relationship to second language Chinese proficiency and writing quality. Language Learning, 72(4), 1128–1169. 10.1111/lang.12511
    https://doi.org/10.1111/lang.12511 [Google Scholar]
  9. Hunt, K. W.
    (1965) Grammatical structures written at three grade levels. National Council of Teachers of English. https://files.eric.ed.gov/fulltext/ED113735.pdf
    [Google Scholar]
  10. (1977) Early blooming and late blooming syntactic structures. InC. R. Coper & L. Odell (Eds.), Evaluating Writing: Describing, Measuring, Judging. National Council of Teachers of English.
    [Google Scholar]
  11. Jagaiah, T., Olinghouse, N. G., & Kearns, D. M.
    (2020) Syntactic complexity measures: variation by genre, grade-level, students’ writing abilities, and writing quality. Reading and Writing, 33(10), 2577–2638. 10.1007/s11145‑020‑10057‑x
    https://doi.org/10.1007/s11145-020-10057-x [Google Scholar]
  12. Jiang, W.
    (2012) Measurements of development in L2 written production: the case of L2 Chinese. Applied Linguistics, 34(1), 1–24. 10.1093/applin/ams019
    https://doi.org/10.1093/applin/ams019 [Google Scholar]
  13. Jin, H.
    (2007) Syntactic maturity in second language writings: a case of Chinese as a foreign language (CFL). Journal of Chinese Language Teachers Association, 42(1), 27–52.
    [Google Scholar]
  14. Larsen-Freeman, D., & Strom, V.
    (1977) The construction of a second language acquisition index of development. Language Learning, 27(1), 123–134. 10.1111/j.1467‑1770.1977.tb00296.x
    https://doi.org/10.1111/j.1467-1770.1977.tb00296.x [Google Scholar]
  15. Lu, X., & Wu, J.
    (2022) Noun-phrase complexity measures in Chinese and their relationship to L2 Chinese writing quality: a comparison with topic–comment-unit-based measures. The Modern Language Journal, 106(1), 267–283. 10.1111/modl.12766
    https://doi.org/10.1111/modl.12766 [Google Scholar]
  16. Mohri, M., Rostamizadeh, A., & Talwalkar, A.
    (2018) Foundations of machine learning. The MIT Press.
    [Google Scholar]
  17. Norris, J. M., & Ortega, L.
    (2009) Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, 30(4), 555–578. 10.1093/applin/amp044
    https://doi.org/10.1093/applin/amp044 [Google Scholar]
  18. Ortega, L.
    (2003) Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics, 24(4), 492–518. 10.1093/applin/24.4.492
    https://doi.org/10.1093/applin/24.4.492 [Google Scholar]
  19. Perkins, K.
    (1980) Using objective methods of attained writing proficiency to discriminate among holistic evaluations. TESOL Quarterly, 14(1), 61. 10.2307/3586809
    https://doi.org/10.2307/3586809 [Google Scholar]
  20. Richards, J. C.
    (2008) Moving beyond the plateau. Cambridge University Press.
    [Google Scholar]
  21. Varoquaux, G., Buitinck, L., Louppe, G., Grisel, O., Pedregosa, F., & Mueller, A.
    (2015) Scikit-learn. GetMobile: Mobile Computing and Communications, 19(1), 29–33. 10.1145/2786984.2786995
    https://doi.org/10.1145/2786984.2786995 [Google Scholar]
  22. Witte, S. P., & Davis, A. J.
    (1980) The stability of t-unit length: a preliminary investigation. Research in the Teaching of English, 14(1), 5–17. 10.58680/rte198015813
    https://doi.org/10.58680/rte198015813 [Google Scholar]
  23. Yu, Q.
    (2021) An organic syntactic complexity measure for the Chinese language: the tc-unit. Applied Linguistics, 42(1), 60–92. 10.1093/applin/amz064
    https://doi.org/10.1093/applin/amz064 [Google Scholar]
  24. Yuan, F.
    (2009) Measuring learner language in L2 Chinese in fluency, accuracy and complexity. Journal of Chinese Language Teachers Association, 44(3), 109–130.
    [Google Scholar]
/content/journals/10.1075/csl.22007.shi
Loading
/content/journals/10.1075/csl.22007.shi
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error