1887
  1. Home
  2. e-Journals
  3. Revista Española de Lingüística Aplicada/Spanish Journal of Applied Linguistics
  4. Online First Articles
  5. Online First Article
image of Assessing voice vs. writing quality
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Using a mixed-methods design, the study aimed to distinguish voice features from the criteria considered in most L2 writing rating scales (e. g., topic development, organization, and quality of language use). Accordingly, a sample of 200 argumentative essays written in English was scored for voice, writing quality, and the critical features of academic writing such as text length, lexical sophistication, and grammatical complexity (see Cumming et al., 2005). Multiple regression and structural equation modeling (SEM) were conducted to verify which of and how the critical elements of academic writing interacted to determine the scores for voice and writing quality. Think-aloud protocols (TAPs) of raters scoring voice and writing quality were also compared. Voice was found an indication of genre competence, rated independently of language use and mostly based on the structure of arguments and the quality with which writers employed certain textual voice elements. In assessing writing quality, however, textual voice elements were dismissed, and the writing quality scores mainly reflected the quality of language use rather than the argument structure. The study provides implications for second language writing assessment and instruction, as well as for future research to be conducted.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/resla.22055.hom
2024-04-05
2024-12-01

  • From This Site

    /content/journals/10.1075/resla.22055.hom
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Barkaoui, K.
    (2011) Effects of marking method and rater experience on ESL essay scores and rater performance. Assessment in Education: Principles, Policy & Practice, (), –. 10.1080/0969594X.2010.526585
     https://doi.org/10.1080/0969594X.2010.526585 [Google Scholar]
  2. Beaufort, A.
    (2007) College writing and beyond: A new framework for university writing instruction. Utah State University Press.
     [Google Scholar]
  3. Burgess, A., & Ivanič, R.
    (2010) Writing and being written: Issues of identity across timescales. Written Communication, , –. 10.1177/0741088310363447
     https://doi.org/10.1177/0741088310363447 [Google Scholar]
  4. Coffin, C.
    (2004) Arguing about how the world is or how the world should be: The role of argument in IELTS tests. Journal of English for Academic Purposes, (), –. 10.1016/j.jeap.2003.11.002
     https://doi.org/10.1016/j.jeap.2003.11.002 [Google Scholar]
  5. Council of Writing Program Administrators
    Council of Writing Program Administrators (2014) The WPA outcomes statement for first-year composition. wpacouncil.org/positions/outcomes.html
     [Google Scholar]
  6. Crossley, S. A., & McNamara, D. S.
    (2009) Computational assessment of lexical differences in L1 and L2 writing. Journal of second language writing, (), –. 10.1016/j.jslw.2009.02.002
     https://doi.org/10.1016/j.jslw.2009.02.002 [Google Scholar]
  7. Cumming, A.
    (1989) Writing expertise and second language proficiency. Language Learning, (), –. 10.1111/j.1467‑1770.1989.tb00592.x
     https://doi.org/10.1111/j.1467-1770.1989.tb00592.x [Google Scholar]
  8. Cumming, A., Kantor, R., Baba, K., Erdosy, U., Eouanzoui, K., & James, M.
    (2005) Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL. Assessing Writing, , –. 10.1016/j.asw.2005.02.001
     https://doi.org/10.1016/j.asw.2005.02.001 [Google Scholar]
  9. DiPardo, A., Stroms, B., & Selland, M.
    (2011) Seeing voices: Assessing writerly stance in the NWP Analytic Writing Continuum, Assessing Writing, , –. 10.1016/j.asw.2011.01.003
     https://doi.org/10.1016/j.asw.2011.01.003 [Google Scholar]
  10. Elbow, P.
    (1994) What do we mean when we talk about voice in texts?InK. B. Yancey (Ed.), Voices on voice (pp.–). NCTE.
     [Google Scholar]
  11. (1999) Individualism and the teaching of writing: response to Vai Ramanathan and Dwight Atkinson, Journal of Second Language Writing, , –. 10.1016/S1060‑3743(99)80120‑9
     https://doi.org/10.1016/S1060-3743(99)80120-9 [Google Scholar]
  12. Ericsson, K. A., & Simon, H. A.
    (1993) Protocol analysis: Verbal reports as data (Rev. ed.). The MIT Press. 10.7551/mitpress/5657.001.0001
     https://doi.org/10.7551/mitpress/5657.001.0001 [Google Scholar]
  13. Gentil, G.
    (2011) A biliteracy agenda for genre research. Journal of Second Language Writing, , –. 10.1016/j.jslw.2010.12.006
     https://doi.org/10.1016/j.jslw.2010.12.006 [Google Scholar]
  14. Helms-Park, R., & Stapleton, P.
    (2003) Questioning the importance of individualized voice in undergraduate L2 argumentative writing: An empirical study with pedagogical implications. Journal of Second Language Writing, , –. 10.1016/j.jslw.2003.08.001
     https://doi.org/10.1016/j.jslw.2003.08.001 [Google Scholar]
  15. Hyland, K.
    (2002) Authority and invisibility: Authorial identity in academic writing. Journal of Pragmatics, , –. 10.1016/S0378‑2166(02)00035‑8
     https://doi.org/10.1016/S0378-2166(02)00035-8 [Google Scholar]
  16. (2005) Representing readers in writing: Student and expert practices. Linguistics and Education, , –. 10.1016/j.linged.2006.05.002
     https://doi.org/10.1016/j.linged.2006.05.002 [Google Scholar]
  17. (2008) Disciplinary voice: Interactions in research writing. English Text Construction, (), –. 10.1075/etc.1.1.03hyl
     https://doi.org/10.1075/etc.1.1.03hyl [Google Scholar]
  18. Ivanič, R.
    (1998) Writing and identity: The discoursal construction of identity in academic writing. John Benjamins. 10.1075/swll.5
     https://doi.org/10.1075/swll.5 [Google Scholar]
  19. Ivanič, R., & Camps, D.
    (2001) I am how I sound: Voice as self-representation in L2 writing. Journal of Second Language Writing, (), –. 10.1016/S1060‑3743(01)00034‑0
     https://doi.org/10.1016/S1060-3743(01)00034-0 [Google Scholar]
  20. Jacobs, H., Zinkgraf, S., Wormuth, D., Hartfiel, V., & Hughey, J.
    (1981) Testing ESL composition: A practical approach. Newbury House.
     [Google Scholar]
  21. Jeffrey, J. V.
    (2009) Constructs of writing proficiency in U.S. state and national writing assessments: Exploring variability. Assessing Writing, , –. 10.1016/j.asw.2008.12.002
     https://doi.org/10.1016/j.asw.2008.12.002 [Google Scholar]
  22. Li, Y., & Deng, L.
    (2021) Disciplinary capable and personally unique: Voicing disciplinary identity in personal statement writing. Journal of English for Academic Purposes, , . 10.1016/j.jeap.2020.100949
     https://doi.org/10.1016/j.jeap.2020.100949 [Google Scholar]
  23. Liu, J.
    (2022) Voice for teaching L2 writing: Affordance or constraint?Journal of Language, Identity & Education, 10.1080/15348458.2022.2145565
     https://doi.org/10.1080/15348458.2022.2145565 [Google Scholar]
  24. Llosa, L., Beck, S. W., & Zhao, C. G.
    (2011) An investigation of academic writing in secondary schools to inform the development of diagnostic classroom assessments. Assessing writing, (), –. 10.1016/j.asw.2011.07.001
     https://doi.org/10.1016/j.asw.2011.07.001 [Google Scholar]
  25. Matsuda, P. K.
    (1997) Contrastive rhetoric in context: A dynamic model of L2 writing. Journal of Second Language Writing, , –. 10.1016/S1060‑3743(97)90005‑9
     https://doi.org/10.1016/S1060-3743(97)90005-9 [Google Scholar]
  26. (2001) Voice in Japanese written discourse: Implications for second language writing. Journal of Second Language Writing, , –. 10.1016/S1060‑3743(00)00036‑9
     https://doi.org/10.1016/S1060-3743(00)00036-9 [Google Scholar]
  27. (2015) Identity in written discourse. Annual Review of Applied Linguistics, , –. 10.1017/S0267190514000178
     https://doi.org/10.1017/S0267190514000178 [Google Scholar]
  28. Matsuda, P. K., & Jeffrey, J.
    (2012) Voice in student essays. InK. Hyland & C. Sancho Guinda (Eds.), Stance and voice in written academic genres (pp.–). Palgrave Macmillan. 10.1057/9781137030825_10
     https://doi.org/10.1057/9781137030825_10 [Google Scholar]
  29. Moore, T., & Morton, J.
    (2005) Dimensions of difference: A comparison of university writing and IELTS writing. Journal of English for Academic Purposes, (), –. 10.1016/j.jeap.2004.02.001
     https://doi.org/10.1016/j.jeap.2004.02.001 [Google Scholar]
  30. Reid, J. M.
    (2001) Writing. InR. Cater & D. Nunan (Eds.), The Cambridge guide to teaching English to speakers of other languages (pp.–). Cambridge University Press. 10.1017/CBO9780511667206.005
     https://doi.org/10.1017/CBO9780511667206.005 [Google Scholar]
  31. Schumann, J.
    (1978) The pidginization process: A model for second language acquisition. Newbury House Publishers.
     [Google Scholar]
  32. Stapleton, P., & Wu, Y.
    (2015) Assessing the quality of arguments in students’ persuasive writing: A case study analyzing the relationship between surface structure and substance. English for Academic Purposes, , –. 10.1016/j.jeap.2014.11.006
     https://doi.org/10.1016/j.jeap.2014.11.006 [Google Scholar]
  33. Tardy, C. M.
    (2009) Building genre knowledge. Parlor Press.
     [Google Scholar]
  34. (2012) Current conceptions of voice. InK. Hyland & C. Sancho Guinda (Eds.), Stance and voice in written academic genres (pp.–). Palgrave Macmillan. 10.1057/9781137030825_3
     https://doi.org/10.1057/9781137030825_3 [Google Scholar]
  35. (2017) The challenge of genre in the academic writing classroom: Implications for L2 writing teacher education. InTeaching writing for academic purposes to multilingual students (pp.–). Routledge. 10.4324/9781315269665‑5
     https://doi.org/10.4324/9781315269665-5 [Google Scholar]
  36. Tardy, C. M., & Matsuda, P. K.
    (2009) The construction of author voice by editorial board members. Written Communication, , –. 10.1177/0741088308327269
     https://doi.org/10.1177/0741088308327269 [Google Scholar]
  37. Toulmin, S. E.
    (1958), The Uses of Argument, Cambridge University Press, Cambridge.
     [Google Scholar]
  38. Watanabe, Y.
    (2001) Read-to-write tasks for the assessment of second language academic writing skills: Investigating text features and rater reactions. Unpublished doctoral dissertation, University of Hawaii-Manoa, Honolulu, HI.
  39. Weigle, S.
    (2002) Assessing writing. Ernst Klett Sprachen. 10.1017/CBO9780511732997
     https://doi.org/10.1017/CBO9780511732997 [Google Scholar]
  40. Williams, J.
    (1981) The phenomenology of error. College Composition and Communication, , –. 10.2307/356689
     https://doi.org/10.2307/356689 [Google Scholar]
  41. Xu, L., & Hu, J.
    (2020) Language feedback responses, voices and identity (re) construction: Experiences of Chinese international doctoral students. Innovations in Education and Teaching International, (), –. 10.1080/14703297.2019.1593214
     https://doi.org/10.1080/14703297.2019.1593214 [Google Scholar]
  42. Yoon, H.
    (2017) Textual voice elements and voice strength in EFL argumentative writing. Assessing Writing, , –. 10.1016/j.asw.2017.02.002
     https://doi.org/10.1016/j.asw.2017.02.002 [Google Scholar]
  43. Zhao, C.
    (2013) Measuring authorial voice strength in L2 argumentative writing: The development and validation of an analytic rubric. Language Testing, , –. 10.1177/0265532212456965
     https://doi.org/10.1177/0265532212456965 [Google Scholar]
  44. (2017) Voice in timed L2 argumentative essay writing. Assessing Writing, , –. 10.1016/j.asw.2016.08.004
     https://doi.org/10.1016/j.asw.2016.08.004 [Google Scholar]
  45. (2019) Writer background and voice construction in L2 writing. Journal of English for Academic Purposes, , –. 10.1016/j.jeap.2018.11.004
     https://doi.org/10.1016/j.jeap.2018.11.004 [Google Scholar]
  46. Zhao, C., & Llosa, L.
    (2008) Voice in high-stakes L1 academic writing assessment: Implications for L2 writing instruction. Assessing Writing, , –. 10.1016/j.asw.2008.10.003
     https://doi.org/10.1016/j.asw.2008.10.003 [Google Scholar]
/content/journals/10.1075/resla.22055.hom
Loading
Assessing voice vs. writing quality
John Benjamins ; https://doi.org/10.1075/resla.22055.hom
/content/journals/10.1075/resla.22055.hom
/content/journals/10.1075/resla.22055.hom
Loading

Data & Media loading...

  • Article Type: Research Article
Keywords: genre ; género ; Academic writing ; calidad de la escritura ; composing competence ; competencia en la escritura ; writing quality ; writing assessment ; escritura académica ; evaluación de la escritura

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error