1887
  1. Home
  2. e-Journals
  3. Journal of Second Language Pronunciation
  4. Volume 6, Issue 2
  5. Article
Volume 6, Issue 2
  • ISSN 2215-1931
  • E-ISSN: 2215-194X
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This study examined whether a negative social bias can influence how teachers evaluate second language (L2) speech. Twenty-eight teachers of L2 German from Western Canada – 14 native speakers (NSs) and 14 proficient non-native speakers (NNSs) – rated recordings of 24 adult L2 learners of German across five speech dimensions (accentedness, comprehensibility, vowel/consonant accuracy, intonation, flow) using 1,000-point scales. Immediately before rating, half of NS and NNS teachers heard critical comments about undergraduate German students’ language skills, while the other half heard no biasing comments. Under negative bias, while the NNS teachers provided favorable evaluations across all five measures, NS teachers followed suit for only intonation and flow, downgrading L2 speakers’ accentedness, comprehensibility, and vowel/consonant accuracy. Findings call into question the relative stability of L2 speech ratings and highlight the importance of social context and teacher status as native versus non-native speakers of the target language in assessments of L2 speaking performance.

© John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/jslp.19015.tay
2020-03-09
2024-10-06

  • From This Site

    /content/journals/10.1075/jslp.19015.tay
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Anderson-Hsieh, J., Johnson, R., & Koehler, K.
    (1992) The relationship between native speaker judgments of nonnative pronunciation and deviance in segmentals, prosody, and syllable structure. Language Learning, 421, 529–555. 10.1111/j.1467‑1770.1992.tb01043.x
     https://doi.org/10.1111/j.1467-1770.1992.tb01043.x [Google Scholar]
  2. Beukeboom, C. J., & Semin, G. R.
    (2006) How mood turns on language. Journal of Experimental Social Psychology, 421, 553–566. doi:  10.1016/j.jesp.2005.09.005
     https://doi.org/10.1016/j.jesp.2005.09.005 [Google Scholar]
  3. Bodenhausen, G. V., Mussweiler, T., Gabriel, S., & Moreno, K. N.
    (2001) Affective influences on stereotyping and intergroup relations. InJ. P. Forgas (Ed.), Handbook of affect and social cognition (pp.319–343). Mahwah, NJ: Lawrence Erlbaum.
     [Google Scholar]
  4. Bongaerts, T., van Summeren, C., Planken, B., & Schils, E.
    (1997) Age and ultimate attainment in the pronunciation of a foreign language. Studies in Second Language Acquisition, 191, 447–465. doi:  10.1017/S0272263197004026
     https://doi.org/10.1017/S0272263197004026 [Google Scholar]
  5. Boughton, Z.
    (2006) When perception isn’t reality: Accent identification and perceptual dialectology in French. Journal of French Language Studies, 161, 277–304. doi:  10.1017/S0959269506002535
     https://doi.org/10.1017/S0959269506002535 [Google Scholar]
  6. Bradlow, A. R., & Bent, T.
    (2008) Perceptual adaptation to non-native speech. Cognition, 1061, 707–729. doi:  10.1016/j.cognition.2007.04.005
     https://doi.org/10.1016/j.cognition.2007.04.005 [Google Scholar]
  7. Brown, A.
    (1995) The effect of rater variables in the development of an occupation-specific language performance test. Language Testing, 121, 1–15. doi:  10.1177/026553229501200101
     https://doi.org/10.1177/026553229501200101 [Google Scholar]
  8. Bryk, A. S., & Schneider, B.
    (2003) Trust in schools: A core resource for school reform. Educational Leadership, 601, 40–45.
     [Google Scholar]
  9. Buckingham, L.
    (2014) Attitudes to English teachers’ accents in the Arabian Gulf. International Journal of Applied Linguistics, 241, 50–73. doi:  10.1111/ijal.12058
     https://doi.org/10.1111/ijal.12058 [Google Scholar]
  10. Carey, M. D., Mannell, R. H., & Dunn, P. K.
    (2011) Does a rater’s familiarity with a candidate’s pronunciation affect the rating in oral proficiency interviews?Language Testing, 281, 201–219. doi:  10.1177/0265532210393704
     https://doi.org/10.1177/0265532210393704 [Google Scholar]
  11. Cargile, A. C., & Giles, H.
    (1997) Understanding language attitudes: Exploring listener affect and identity. Language & Communication, 171, 195–217. doi:  10.1016/S0271‑5309(97)00016‑5
     https://doi.org/10.1016/S0271-5309(97)00016-5 [Google Scholar]
  12. Chiba, R., Matsuura, H., & Yamamoto, A.
    (1995) Japanese attitudes toward English accents. World Englishes, 141, 77–86. doi:  10.1111/j.1467‑971X.1995.tb00341.x
     https://doi.org/10.1111/j.1467-971X.1995.tb00341.x [Google Scholar]
  13. Crowther, D., Trofimovich, P., & Isaacs, T.
    (2016) Linguistic dimensions of second language accent and comprehensibility. Journal of Second Language Pronunciation, 21, 160–182. doi:  10.1075/jslp.2.2.02cro
     https://doi.org/10.1075/jslp.2.2.02cro [Google Scholar]
  14. D’Onofrio, A.
    (2018) Controlled and automatic perceptions of a sociolinguistic marker. Language Variation and Change, 301, 261–285. doi:  10.1017/S095439451800008X
     https://doi.org/10.1017/S095439451800008X [Google Scholar]
  15. (forthcoming). Sociolinguistic signs as cognitive representations. InL. Hall-Lew, E. Moore, & R. J. Podesva Eds. Social meaning and linguistic variation. Cambridge, UK: Cambridge University Press.
     [Google Scholar]
  16. Dailey-O’Cain, J.
    (1999) The perception of post-unification German regional speech. InD. R. Preston (Ed.), Handbook of perceptual dialectology (Vol11, pp.227–242). Philadelphia, PA: John Benjamins. 10.1075/z.hpd1.23dai
     https://doi.org/10.1075/z.hpd1.23dai [Google Scholar]
  17. Dalton-Puffer, C., Kaltenböck, G., & Smit, U.
    (1997) Learner attitudes and L2 pronunciation in Austria. World Englishes, 161, 115–128. doi:  10.1111/1467‑971X.00052
     https://doi.org/10.1111/1467-971X.00052 [Google Scholar]
  18. Derwing, T. M., & Munro, M.
    (2013) The development of L2 oral language skills in two L1 groups: A 7-year study. Language Learning, 631, 163–185. doi:  10.1111/lang.12000
     https://doi.org/10.1111/lang.12000 [Google Scholar]
  19. Derwing, T. M., & Munro, M. J.
    (2015) Pronunciation fundamentals: Evidence-based perspectives for L2 teaching and research. Philadelphia, PA: John Benjamins. 10.1075/lllt.42
     https://doi.org/10.1075/lllt.42 [Google Scholar]
  20. Derwing, T. M., Rossiter, M. J., Munro, M. J., & Thomson, R. I.
    (2004) Second language fluency: Judgments on different tasks. Language Learning, 541, 655–679. doi:  10.1111/j.1467‑9922.2004.00282.x
     https://doi.org/10.1111/j.1467-9922.2004.00282.x [Google Scholar]
  21. Eskenazi, M.
    (2009) An overview of spoken language technology for education. Speech Communication, 511, 832–844. doi:  10.1016/j.specom.2009.04.005
     https://doi.org/10.1016/j.specom.2009.04.005 [Google Scholar]
  22. Fayer, J. M., & Krasinski, E.
    (1987) Native and nonnative judgments of intelligibility and irritation. Language Learning, 371, 313–326. doi:  10.1111/j.1467‑1770.1987.tb00573.x
     https://doi.org/10.1111/j.1467-1770.1987.tb00573.x [Google Scholar]
  23. Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R.
    (1986) On the automatic activation of attitudes. Journal of Personality and Social Psychology, 501, 229–238. doi:  10.1037/0022‑3514.50.2.229
     https://doi.org/10.1037/0022-3514.50.2.229 [Google Scholar]
  24. Foote, J. A., & Trofimovich, P.
    (2018) Is it because of my language background? A study of language background influence on comprehensibility judgments. Canadian Modern Language Review, 741, 253–278. doi:  10.3138/cmlr.2017‑0011
     https://doi.org/10.3138/cmlr.2017-0011 [Google Scholar]
  25. Ford, C. E.
    (1984) The influence of speech variety on teachers’ evaluation of students with comparable academic ability. TESOL Quarterly, 181, 25–40. doi:  10.2307/3586333
     https://doi.org/10.2307/3586333 [Google Scholar]
  26. Galinsky, A. D., & Moskowitz, G. B.
    (2000) Perspective-taking: Decreasing stereotype expression, stereotype accessibility, and in-group favoritism. Journal of Personality and Social Psychology, 781, 708–724. doi:  10.1037/0022‑3514.78.4.708
     https://doi.org/10.1037/0022-3514.78.4.708 [Google Scholar]
  27. Goethe Institut
    Goethe Institut (2004) Einstufungstest [Placement test]. www.goethe.de/cgi-bin/einstufungstest/einstufungstest.pl
  28. Hansen Edwards, J. G., Zampini, M. L., & Cunningham, C.
    (2018) The accentedness, comprehensibility, and intelligibility of Asian Englishes. World Englishes, 371, 538–557. doi:  10.1111/weng.12344
     https://doi.org/10.1111/weng.12344 [Google Scholar]
  29. (2019) Listener judgments of speaker and speech traits of varieties of Asian English. Journal of Multilingual and Multicultural Development, 401, 691–706. doi:  10.1080/01434632.2018.1549057
     https://doi.org/10.1080/01434632.2018.1549057 [Google Scholar]
  30. Hansen, K., Rakić, T., & Steffens, M. C.
    (2014) When actions speak louder than words: Preventing discrimination of nonstandard speakers. Journal of Language and Social Psychology, 331, 68–77. doi:  10.1177/0261927X13499761
     https://doi.org/10.1177/0261927X13499761 [Google Scholar]
  31. He, D., & Miller, L.
    (2011) English teacher preference: The case of China’s non-English-major students. World Englishes, 301, 428–443. doi:  10.1111/j.1467‑971X.2011.01716.x
     https://doi.org/10.1111/j.1467-971X.2011.01716.x [Google Scholar]
  32. Hu, G., & Lindemann, S.
    (2009) Stereotypes of Cantonese English, apparent native/non-native status, and their effect on non-native English speakers’ perception. Journal of Multilingual and Multicultural Development, 301, 253–269. doi:  10.1080/01434630802651677
     https://doi.org/10.1080/01434630802651677 [Google Scholar]
  33. Hu, G., & Su, J.
    (2015) The effect of native/non-native information on non-native listeners’ comprehension. Language Awareness, 241, 273–281. doi:  10.1080/09658416.2015.1077853
     https://doi.org/10.1080/09658416.2015.1077853 [Google Scholar]
  34. Hundt, M., Zipp, L., & Huber, A.
    (2015) Attitudes in Fiji towards varieties of English. World Englishes, 341, 688–707. doi:  10.1111/weng.12160
     https://doi.org/10.1111/weng.12160 [Google Scholar]
  35. Isaacs, T., & Thomson, R. I.
    (2013) Rater experience, rating scale length, and judgments of L2 pronunciation: Revisiting research conventions. Language Assessment Quarterly, 101, 135–159. doi:  10.1080/15434303.2013.769545
     https://doi.org/10.1080/15434303.2013.769545 [Google Scholar]
  36. Kang, O.
    (2012) Impact of rater characteristics and prosodic features of speaker accentedness on ratings of international teaching assistants’ oral performance. Language Assessment Quarterly, 91, 249–269. doi:  10.1080/15434303.2011.642631
     https://doi.org/10.1080/15434303.2011.642631 [Google Scholar]
  37. Kang, O., & Rubin, D. L.
    (2009) Reverse linguistic stereotyping: Measuring the effect of listener expectations on speech evaluation. Journal of Language and Social Psychology, 281, 441–456. doi:  10.1177/0261927X09341950
     https://doi.org/10.1177/0261927X09341950 [Google Scholar]
  38. Kawakami, K., Phills, C. E., Greenwald, A. G., Simard, D., Pontiero, J., Brnjas, A., & Dovidio, J. F.
    (2012) In perfect harmony: Synchronizing the self to activated social categories. Journal of Personality and Social Psychology, 1021, 562–575. doi:  10.1037/a0025970
     https://doi.org/10.1037/a0025970 [Google Scholar]
  39. Lambert, W. E., Hodgson, R. C., Gardner, R. C., & Fillenbaum, S.
    (1960) Evaluational reactions to spoken languages. The Journal of Abnormal and Social Psychology, 601, 44–51. doi:  10.1037/h0044430
     https://doi.org/10.1037/h0044430 [Google Scholar]
  40. Lappin-Fortin, K., & Rye, B. J.
    (2014) The use of pre-/posttest and self-assessment tools in a French pronunciation course. Foreign Language Annals, 471, 300–320. 10.1111/flan.12083
     https://doi.org/10.1111/flan.12083 [Google Scholar]
  41. Lindemann, S.
    (2003) Koreans, Chinese or Indians? Attitudes and ideologies about non-native English speakers in the United States. Journal of Sociolinguistics, 71, 348–364. doi:  10.1111/1467‑9481.00228
     https://doi.org/10.1111/1467-9481.00228 [Google Scholar]
  42. Major, R. C., Fitzmaurice, S. F., Bunta, F., & Balasubramanian, C.
    (2002) The effects of non-native accents on listening comprehension: Implications for ESL assessment. TESOL Quarterly, 361, 173–190. 10.2307/3588329
     https://doi.org/10.2307/3588329 [Google Scholar]
  43. Montgomery, C.
    (2007) Northern English dialects: A perceptual approach (Unpublished PhD dissertation). University of Sheffield, Sheffield, United Kingdom.
     [Google Scholar]
  44. Munro, M. J., Derwing, T. M., & Morton, S. L.
    (2006) The mutual intelligibility of L2 speech. Studies in Second Language Acquisition, 281, 111–131. doi:  10.1017/S0272263106060049
     https://doi.org/10.1017/S0272263106060049 [Google Scholar]
  45. Norton, B., & Toohey, K.
    (2011) Identity, language learning, and social change. Language Teaching, 441, 412–446. doi:  10.1017/S0261444811000309
     https://doi.org/10.1017/S0261444811000309 [Google Scholar]
  46. O’Brien, M. G.
    (2014) L2 learners’ assessments of accentedness, fluency, and comprehensibility of native and nonnative German speech. Language Learning, 641, 715–748. doi:  10.1111/lang.12082
     https://doi.org/10.1111/lang.12082 [Google Scholar]
  47. Pantos, A. J., & Perkins, A. W.
    (2013) Measuring implicit and explicit attitudes toward foreign accented speech. Journal of Language and Social Psychology, 321, 3–20. doi:  10.1177/0261927X12463005
     https://doi.org/10.1177/0261927X12463005 [Google Scholar]
  48. Preston, D.
    (1999) Handbook of perceptual dialectology11. Philadelphia, PA: John Benjamins. doi:  10.1075/z.hpd1
     https://doi.org/10.1075/z.hpd1 [Google Scholar]
  49. Reid, K. T., Trofimovich, P., & O’Brien, M. G.
    (2019) Social attitudes and speech ratings: Effects of positive and negative bias on multiage listeners’ judgments of second language speech. Studies in Second Language Acquisition, 411, 419–442. doi:  10.1017/S0272263118000244
     https://doi.org/10.1017/S0272263118000244 [Google Scholar]
  50. Rose, R. L.
    (2017) Differences in second language speech fluency ratings: Native versus nonnative listeners. InL. Degand (Eds.), Proceedings of the International Conference “Fluency & Disfluency Across Languages and Language Varieties” (pp.101–103). Louvain-la-Neuve, Belgium: Université catholique de Louvain.
     [Google Scholar]
  51. Rossiter, M. J.
    (2009) Perceptions of L2 fluency by native and non-native speakers of English. Canadian Modern Language Review, 651, 395–412. doi:  10.3138/cmlr.65.3.395
     https://doi.org/10.3138/cmlr.65.3.395 [Google Scholar]
  52. Rubin, D. L.
    (1992) Nonlanguage factors affecting undergraduates’ judgments of nonnative English-speaking teaching assistants. Research in Higher Education, 331, 51–531. doi:  10.1007/BF00973770
     https://doi.org/10.1007/BF00973770 [Google Scholar]
  53. Ryan, E. B., Carranza, M. A., & Moffie, R. W.
    (1977) Reactions toward varying degrees of accentedness in the speech of Spanish-English bilinguals. Language and Speech, 201, 267–273. 10.1177/002383097702000308
     https://doi.org/10.1177/002383097702000308 [Google Scholar]
  54. Ryan, E. B., Hewstone, M., & Giles, H.
    (1984) Language and intergroup attitudes. InJ. R. Eiser (Ed.), Attitudinal judgment (pp.135–158). New York: Springer. 10.1007/978‑1‑4613‑8251‑5_7
     https://doi.org/10.1007/978-1-4613-8251-5_7 [Google Scholar]
  55. Sokolov, C.
    (2014) Self-evaluation of rater bias in written composition assessment. Linguistica, 541, 261–275. doi:  10.4312/linguistica.54.1.261‑275
     https://doi.org/10.4312/linguistica.54.1.261-275 [Google Scholar]
  56. Spillane, J. P.
    (2006) Distributed leadership. San Francisco, CA: Jossey-Bass. doi:  10.1093/obo/9780199756810‑0123
     https://doi.org/10.1093/obo/9780199756810-0123 [Google Scholar]
  57. Spillane, J. P., Hallett, T., & Diamond, J. B.
    (2003) Forms of capital and the construction of leadership: Instructional leadership in urban elementary schools. Sociology of Education, 761, 1–17. doi:  10.2307/3090258
     https://doi.org/10.2307/3090258 [Google Scholar]
  58. Steele, C. M., & Aronson, J.
    (1995) Stereotype threat and the intellectual test performance of African Americans. Journal of Personality and Social Psychology, 691, 797–811. doi:  10.1037/0022‑3514.69.5.797
     https://doi.org/10.1037/0022-3514.69.5.797 [Google Scholar]
  59. Stewart, M. A., Ryan, E. G., & Giles, H.
    (1985) Accent and social class effects on status and solidarity evaluations. Personality and Social Psychology Bulletin, 111, 98–105. doi:  10.1177/0146167285111009
     https://doi.org/10.1177/0146167285111009 [Google Scholar]
  60. Tajfel, H.
    (1972) Experiments in a vacuum. InJ. Israel & H. T. Triandis (Eds.), The context of social psychology: A critical assessment (pp.69–119). London, UK: Academic Press.
     [Google Scholar]
  61. Tan, Y.-Y., & Castelli, C.
    (2013) Intelligibility and attitudes: How American and Singapore English are perceived around the world. English World-Wide, 341, 177–201. doi:  10.1075/eww.34.2.03tan
     https://doi.org/10.1075/eww.34.2.03tan [Google Scholar]
  62. Isaacs, T., & Trofimovich, P.
    (2012) Deconstructing comprehensibility: Identifying the linguistic influences on listeners’ L2 comprehensibility ratings. Studies in Second Language Acquisition, 341, 475–505. doi:  10.1017/S0272263112000150
     https://doi.org/10.1017/S0272263112000150 [Google Scholar]
  63. van Bezooijen, R.
    (2002) Aesthetic evaluation of Dutch: Comparisons across dialects, accents and languages. InD. Long & D. Preston (Eds.), Handbook of perceptual dialectology (Vol.21, pp.13–30). Amsterdam, The Netherlands: John Benjamins. doi:  10.1075/z.hpd2.07bez
     https://doi.org/10.1075/z.hpd2.07bez [Google Scholar]
  64. Visser, P. S., & Cooper, J.
    (2007) Attitude change. The Sage handbook of social psychology (pp.197–218). Thousand Oaks, CA: Sage. doi:  10.4135/9781848608221.n9
     https://doi.org/10.4135/9781848608221.n9 [Google Scholar]
  65. Vissers, C. T. W. M., Virgillito, D., Fitzgerald, D. A., Speckens, A. E. M., Tendolkar, I., Van Oostrom, I., & Chwilla, D. J.
    (2010) The influence of mood on the processing of syntactic anomalies: Evidence from P600. Neuropsychologia, 481, 3521–3531. 10.1016/j.neuropsychologia.2010.08.001
     https://doi.org/10.1016/j.neuropsychologia.2010.08.001 [Google Scholar]
  66. Watson, K., & Clark, L.
    (2015) Exploring listeners’ real-time reactions to regional accents. Language Awareness, 241, 38–59. doi:  10.1080/09658416.2014.882346
     https://doi.org/10.1080/09658416.2014.882346 [Google Scholar]
  67. Wheelan, S., & Kaeser, R. M.
    (1997) The influence of task type and designated leaders on developmental patterns in groups. Small Group Research, 281, 94–121. doi:  10.1177/1046496497281004
     https://doi.org/10.1177/1046496497281004 [Google Scholar]
  68. Winke, P.
    (2013) Rating oral language. InC. A. Chapelle (Ed.), The encyclopedia of applied linguistics (pp.1–7). Hoboken, NJ: Blackwell. doi:  10.1002/9781405198431.wbeal0993
     https://doi.org/10.1002/9781405198431.wbeal0993 [Google Scholar]
  69. Winke, P., & Gass, S.
    (2013) The influence of second language experience and accent familiarity on oral proficiency rating: A qualitative investigation. TESOL Quarterly, 471, 762–789. doi:  10.1002/tesq.73
     https://doi.org/10.1002/tesq.73 [Google Scholar]
  70. Winke, P., Gass, S., & Myford, C.
    (2013) Raters’ L2 background as a potential source of bias in rating oral performance. Language Testing, 301, 231–252. doi:  10.1177/0265532212456968
     https://doi.org/10.1177/0265532212456968 [Google Scholar]
  71. Xu, W., Wang, Y., & Case, R. E.
    (2010) Chinese attitudes towards varieties of English: A pre-Olympic examination. Language Awareness, 191, 249–260. doi:  10.1080/09658416.2010.508528
     https://doi.org/10.1080/09658416.2010.508528 [Google Scholar]
  72. Yao, Z., Saito, K., Trofimovich, P., & Isaacs, T.
    (2013) Z-Lab [Computer software]. https://github.com/ZeshanYao/Z-Lab
/content/journals/10.1075/jslp.19015.tay
Loading
Testing the malleability of teachers’ judgments of second language speech
Journal of Second Language Pronunciation 6, 236 (2020); https://doi.org/10.1075/jslp.19015.tay
/content/journals/10.1075/jslp.19015.tay
/content/journals/10.1075/jslp.19015.tay
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): accent bias; accentedness; comprehensibility; fluency; German; linguistic stereotyping; second language; social attitudes; speech assessment; speech rating; teacher status

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error