1887
image of A machine learning-based investigation of syntactic complexity measures in second language acquisition of Chinese
USD
Buy:$35.00 + Taxes

Abstract

Abstract

L2 syntactic complexity research has shown that employing multidimensional measures to assess writing proficiency levels may yield more accurate results compared to one-dimensional measures. However, the optimal number and combination of measures have not been thoroughly explored. This study addresses these gaps by employing a novel machine learning-based approach to quantitatively investigate the effectiveness of multidimensional measures and determine the optimal combination of measures. Through the analysis of a dataset comprising 36 L2 Chinese learners, we found that multidimensional syntactic complexity measures outperformed one-dimensional measures in accurately differentiating learners. Specifically, a combination of three measures (Mean Length of Sentence, Mean Length of T-unit, and Mean Length of Clause) achieved the highest accuracy in classifying the learners. The implications of this research include the development of computer-assisted placement tests and proficiency evaluations, as well as providing practical guidance for language teachers in designing complexity-based instruction.

Loading

Article metrics loading...

/content/journals/10.1075/csl.22007.shi
2024-09-06
2024-10-06
Loading full text...

Full text loading...

References

  1. ACTFL
    ACTFL (2012) ACTFL Proficiency Guidelines 2012. ACTFL. https://www.actfl.org/educator-resources/actfl-proficiency-guidelines
    [Google Scholar]
  2. Aydin, S.
    (2009) Test anxiety among foreign language learners: a review of literature. Journal of Language and Linguistic Studies, (), –. 10.17263/jlls.09435
    https://doi.org/10.17263/jlls.09435 [Google Scholar]
  3. Bardovi-Harlig, K.
    (1992) A second look at t-unit analysis: Reconsidering the sentence. TESOL Quarterly, (), . 10.2307/3587016
    https://doi.org/10.2307/3587016 [Google Scholar]
  4. Chen, M.
    (2015) Hanyu zuowei di’er yuyan ziran kouyu chanchu de fuzadu, zhunquedu he liulidu yanjiu汉语作为第二语言自然口语产出的复杂度, 准确度和流利度研究[A complexity, accuracy and fluency study on natural oral production of Chinese as a second language]. Yuyan jiaoxue yu yanjiu语言教学与研究 [Language Teaching and Linguistic Studies], , –.
    [Google Scholar]
  5. Chen, M., & Li, Y.
    (2016) Hanyu muyuzhe Hanyu kouyu fuzadu yanjiu汉语母语者汉语口语复杂度研究 [The complexity of Chinese oral speeches by Korean native speakers]. Yuyan Wenzi Yingyong语言文字应用 [Applied Linguistics], , –.
    [Google Scholar]
  6. Halliday, M. A. K., & Matthiessen, C.
    (2006) Construing experience through meaning : A language-based approach to cognition. Continuum.
    [Google Scholar]
  7. Han, X., & Feng, L.
    (2017) Hanyu kouyu jufa fuzadu fazhan zeping zhong jizhunxing zhibiao de yingyong fangfa yanjiu汉语口语句法复杂度发展测评中基准型指标的应用方法研究 [The application method research of benchmark measures in Chinese oral syntactic complexity development assessment]. Shijie Hanyu jiaoxue世界汉语教学 [Chinese Teaching in the World], (), –.
    [Google Scholar]
  8. Hu, R., Wu, J., & Lu, X.
    (2022) Word-combination-based measures of phraseological diversity, sophistication, and complexity and their relationship to second language Chinese proficiency and writing quality. Language Learning, (). 10.1111/lang.12511
    https://doi.org/10.1111/lang.12511 [Google Scholar]
  9. Hunt, K. W.
    (1965) Grammatical structures written at three grade levels. National Council of Teachers of English. https://files.eric.ed.gov/fulltext/ED113735.pdf
    [Google Scholar]
  10. (1977) Early blooming and late blooming syntactic structures. InC. R. Coper & L. Odell (Eds.), Evaluating Writing: Describing, Measuring, Judging. National Council of Teachers of English.
    [Google Scholar]
  11. Jagaiah, T., Olinghouse, N. G., & Kearns, D. M.
    (2020) Syntactic complexity measures: variation by genre, grade-level, students’ writing abilities, and writing quality. Reading and Writing, (), –. 10.1007/s11145‑020‑10057‑x
    https://doi.org/10.1007/s11145-020-10057-x [Google Scholar]
  12. Jiang, W.
    (2012) Measurements of development in L2 written production: the case of L2 Chinese. Applied Linguistics, (), –. 10.1093/applin/ams019
    https://doi.org/10.1093/applin/ams019 [Google Scholar]
  13. Jin, H.
    (2007) Syntactic maturity in second language writings: a case of Chinese as a foreign language (CFL). Journal of Chinese Language Teachers Association, ().
    [Google Scholar]
  14. Larsen-Freeman, D., & Strom, V.
    (1977) The construction of a second language acquisition index of development. Language Learning, (), –. 10.1111/j.1467‑1770.1977.tb00296.x
    https://doi.org/10.1111/j.1467-1770.1977.tb00296.x [Google Scholar]
  15. Lu, X., & Wu, J.
    (2022) Noun-phrase complexity measures in Chinese and their relationship to L2 Chinese writing quality: a comparison with topic–comment-unit-based measures. The Modern Language Journal, (), –. 10.1111/modl.12766
    https://doi.org/10.1111/modl.12766 [Google Scholar]
  16. Mohri, M., Rostamizadeh, A., & Talwalkar, A.
    (2018) Foundations of machine learning. The MIT Press.
    [Google Scholar]
  17. Norris, J. M., & Ortega, L.
    (2009) Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Applied Linguistics, (), –. 10.1093/applin/amp044
    https://doi.org/10.1093/applin/amp044 [Google Scholar]
  18. Ortega, L.
    (2003) Syntactic complexity measures and their relationship to L2 proficiency: A research synthesis of college-level L2 writing. Applied Linguistics, (), –. 10.1093/applin/24.4.492
    https://doi.org/10.1093/applin/24.4.492 [Google Scholar]
  19. Perkins, K.
    (1980) Using objective methods of attained writing proficiency to discriminate among holistic evaluations. TESOL Quarterly, (), . 10.2307/3586809
    https://doi.org/10.2307/3586809 [Google Scholar]
  20. Richards, J. C.
    (2008) Moving beyond the plateau. Cambridge University Press.
    [Google Scholar]
  21. Varoquaux, G., Buitinck, L., Louppe, G., Grisel, O., Pedregosa, F., & Mueller, A.
    (2015) Scikit-learn. GetMobile: Mobile Computing and Communications, (), –. 10.1145/2786984.2786995
    https://doi.org/10.1145/2786984.2786995 [Google Scholar]
  22. Witte, S. P., & Davis, A. J.
    (1980) The stability of t-unit length: a preliminary investigation. Research in the Teaching of English, (), –. 10.58680/rte198015813
    https://doi.org/10.58680/rte198015813 [Google Scholar]
  23. Yu, Q.
    (2021) An organic syntactic complexity measure for the Chinese language: the tc-unit. Applied Linguistics, (), –. 10.1093/applin/amz064
    https://doi.org/10.1093/applin/amz064 [Google Scholar]
  24. Yuan, F.
    (2009) Measuring learner language in L2 Chinese in fluency, accuracy and complexity. Journal of Chinese Language Teachers Association, (), –.
    [Google Scholar]
/content/journals/10.1075/csl.22007.shi
Loading
/content/journals/10.1075/csl.22007.shi
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error