1887
Volume 37, Issue 1
  • ISSN 0213-2028
  • E-ISSN: 2254-6774
USD
Buy:$35.00 + Taxes

Abstract

Resumen

El presente experimento analiza las divergencias entre la autoevaluación que un grupo de 40 hablantes de español como L2 emite sobre su grado de comprensibilidad, acento extranjero y fluidez, y las evaluaciones que recibe por parte de dos grupos de jueces: 109 No expertos sin experiencia en la enseñanza y 42 Expertos o profesores de español como L2. El propósito del experimento es analizar las diferencias entre estas evaluaciones considerando los grados de desempeño de los hablantes, ya que diversos estudios han demostrado que los participantes con peor competencia tienden a sobrevalorar su habilidad, mientras que aquellos situados en lo alto de la escala tienden a subestimarla (Kruger & Dunning, 1999). Este efecto, conocido como «Dunning-Kruger», resulta relevante para conocer hasta qué punto la autoevaluación de estas tres dimensiones por parte de aprendientes de español se corresponde con la evaluación de los interlocutores nativos con los que ellos interactúan habitualmente dentro y fuera del aula. Los resultados muestran que, efectivamente, los hablantes con peor desempeño se sobrevaloran y los que fueron mejor valorados se infravaloran, aunque la experiencia de los jueces resulta relevante a la hora de marcar la significatividad estadística de las diferencias y los tamaños del efecto.

Loading

Article metrics loading...

/content/journals/10.1075/resla.21023.san
2023-11-17
2024-07-19
Loading full text...

Full text loading...

References

  1. Aqueveque, C.
    (2018) Ignorant experts and erudite novices: Exploring the Dunning-Kruger effect in wine consumers. Food Quality and Preference, 651, 181–184. 10.1016/j.foodqual.2017.12.007
    https://doi.org/10.1016/j.foodqual.2017.12.007 [Google Scholar]
  2. Babaii, E., Taghaddomi, S. y Pashmforoosh, R.
    (2016) Speaking self-assessment: Mismatches between learners’ and teachers’ criteria. Language Testing, 33(3), 411–437. 10.1177/0265532215590847
    https://doi.org/10.1177/0265532215590847 [Google Scholar]
  3. Brantmeier, C., Vanderplank, R. y Strube, M.
    (2012) What about me? Individual self-assessment by skill and level of language instruction. System, 40(1), 144–160. 10.1016/j.system.2012.01.003
    https://doi.org/10.1016/j.system.2012.01.003 [Google Scholar]
  4. Burson, K. A., Larrick, R. P. y Klayman, J.
    (2006) Skilled or unskilled, but still unaware of it: How perceptions of difficulty drive miscalibration in relative comparisons. Journal of Personality and Social Psychology, 90(1), 60–77. 10.1037/0022‑3514.90.1.60
    https://doi.org/10.1037/0022-3514.90.1.60 [Google Scholar]
  5. Camerer, C. y Lovallo, D.
    (1999) Overconfidence and excess entry: An experimental approach. The American Economic Review, 89(1), 306–318. 10.1257/aer.89.1.306
    https://doi.org/10.1257/aer.89.1.306 [Google Scholar]
  6. Carter, T. J. y Dunning, D.
    (2008) Faulty self-assessment: Why evaluating one’s own competence is an intrinsically difficult task. Social and Personality Psychology Compass, 2(1), 346–360. 10.1111/j.1751‑9004.2007.00031.x
    https://doi.org/10.1111/j.1751-9004.2007.00031.x [Google Scholar]
  7. Celce-Murcia, M., Brinton, D., Goodwin, J. y Griner, B.
    (2010) Teaching pronunciation. A course book and reference guide. Cambridge University Press.
    [Google Scholar]
  8. Consejo de Europa
    Consejo de Europa (2018) Common European Framework of Reference for Languages: Learning, teaching, assessment companion volume with new descriptors. Consejo de Europa. www.coe.int/lang-cefr
    [Google Scholar]
  9. Critcher, C. R. y Dunning, D.
    (2009) How chronic self-views influence (and mislead) self-assessments of task performance: Self-views shape bottom-up experiences with the task. Journal of Personality and Social Psychology, 97(6), 931–945. 10.1037/a0017452
    https://doi.org/10.1037/a0017452 [Google Scholar]
  10. de Saint Léger, D.
    (2009) Self-assessment of speaking skills and participation in a foreign language class. Foreign Language Annals, 42(1), 158–178. 10.1111/j.1944‑9720.2009.01013.x
    https://doi.org/10.1111/j.1944-9720.2009.01013.x [Google Scholar]
  11. Derwing, T. M. y Munro, M. J.
    (2009) Comprehensibility as a Factor in Listener Interaction Preferences: Implications for the Workplace. Canadian Modern Language Review, 66(2), 181–202. 10.3138/cmlr.66.2.181
    https://doi.org/10.3138/cmlr.66.2.181 [Google Scholar]
  12. Derwing, T. M., Munro, M. J. y Thomson, R. I.
    (2008) A longitudinal study of ESL learners’ fluency and comprehensibility development. Applied Linguistics, 29(3), 359–380. 10.1093/applin/amm041
    https://doi.org/10.1093/applin/amm041 [Google Scholar]
  13. Dlaska, A. y Krekeler, C.
    (2008) Self-assessment of pronunciation. System, 36(4), 506–516. 10.1016/j.system.2008.03.003
    https://doi.org/10.1016/j.system.2008.03.003 [Google Scholar]
  14. Dunning, D., Heath, C. y Suls, J. M.
    (2004) Flawed self-assessment implications for health, education, and the workplace. Psychological Science in the Public Interest, 5(3), 69–107. 10.1111/j.1529‑1006.2004.00018.x
    https://doi.org/10.1111/j.1529-1006.2004.00018.x [Google Scholar]
  15. Dunning, D., Johnson, K., Ehrlinger, J. y Kruger, J.
    (2003) Why people fail to recognize their own incompetence. Current Directions in Psychological Science, 12(3), 83–88. 10.1111/1467‑8721.01235
    https://doi.org/10.1111/1467-8721.01235 [Google Scholar]
  16. Ehrlinger, J. y Dunning, D.
    (2003) How chronic self-views influence (and potentially mislead) estimates of performance. Attitudes and Social Cognition, 84(1), 5–17. 10.1037/0022‑3514.84.1.5
    https://doi.org/10.1037/0022-3514.84.1.5 [Google Scholar]
  17. Ehrlinger, J., Johnson, K., Banner, M., Dunning, D. y Kruger, J.
    (2008) Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent. Organizational Behavior and Human Decision Processes, 105(1), 98–121. 10.1016/j.obhdp.2007.05.002
    https://doi.org/10.1016/j.obhdp.2007.05.002 [Google Scholar]
  18. Feld, J., Sauermann, J. y de Grip, A.
    (2017) Estimating the relationship between skill and overconfidence. Journal of Behavioral and Experimental Economics, 681, 18–24. 10.1016/j.socec.2017.03.002
    https://doi.org/10.1016/j.socec.2017.03.002 [Google Scholar]
  19. Ferraro, P. J.
    (2010) Know thyself: Competence and self-awareness. Atlantic Economic Journal, 38(2), 183–196. 10.1007/s11293‑010‑9226‑2
    https://doi.org/10.1007/s11293-010-9226-2 [Google Scholar]
  20. Foote, J.
    (2010) Second language learners’ perceptions of their own recorded speech. PMC Working Paper Series, 10(2), 3–27. 10.1111/j.1467‑629X.1984.tb00054.x
    https://doi.org/10.1111/j.1467-629X.1984.tb00054.x [Google Scholar]
  21. Foote, J. A., Trofimovich, P., Collins, L. y Soler Urzúa, F.
    (2016) Pronunciation teaching practices in communicative second language classes. The Language Learning Journal, 44(2), 181–196. 10.1080/09571736.2013.784345
    https://doi.org/10.1080/09571736.2013.784345 [Google Scholar]
  22. Foster, N. L., Was, C. A., Dunlosky, J. y Isaacson, R. M.
    (2017) Even after thirteen class exams, students are still overconfident: The role of memory for past exam performance in student predictions. Metacognition and Learning, 12(1), 1–19. 10.1007/s11409‑016‑9158‑6
    https://doi.org/10.1007/s11409-016-9158-6 [Google Scholar]
  23. Freund, B., Colgrove, L. A., Burke, B. L. y Mcleod, R.
    (2005) Self-rated driving performance among elderly drivers referred for driving evaluation. Accident Analysis and Prevention, 37(4), 613–618. 10.1016/j.aap.2005.03.002
    https://doi.org/10.1016/j.aap.2005.03.002 [Google Scholar]
  24. Gibbs, S., Moore, K., Steel, G. y Mckinnon, A.
    (2017) Computers in human behavior The Dunning-Kruger effect in a workplace computing setting. Computers in Human Behavior, 721, 589–595. 10.1016/j.chb.2016.12.084
    https://doi.org/10.1016/j.chb.2016.12.084 [Google Scholar]
  25. Hacker, D. J., Bol, L., Horgan, D. D. y Rakow, E. A.
    (2000) Test prediction and performance in a classroom context. Journal of Educational Psychology, 92(1), 160–170. 10.1037/0022‑0663.92.1.160
    https://doi.org/10.1037/0022-0663.92.1.160 [Google Scholar]
  26. Händel, M. y Dresel, M.
    (2018) Confidence in performance judgment accuracy: The unskilled and unaware effect revisited. Metacognition and Learning, 13(3), 265–285. 10.1007/s11409‑018‑9185‑6
    https://doi.org/10.1007/s11409-018-9185-6 [Google Scholar]
  27. Haun, D. E., Zeringue, A., Leach, A. y Foley, A.
    (2000) Assessing the competence of specimen-processing personnel. Laboratory Medicine, 31(11), 633–637. 10.1309/8Y66‑NCN2‑J8NH‑U66R
    https://doi.org/10.1309/8Y66-NCN2-J8NH-U66R [Google Scholar]
  28. Hopkins, K. D., Hopkins, B. R. y Glass, G. V.
    (1996) Basic statistics for the behavioural sciences (3rd ed.). Allyn & Bacon.
    [Google Scholar]
  29. Huhta, A., Kallio, H., Ohranen, S. y Ullakonoja, R.
    (2020) Fluency in language assessment. EnP. Lintunen, M. Mutta, y P. Peltonen (Eds.), Fluency in L2 learning and use (pp.129–145). Multilingual Matters. 10.21832/9781788926317‑011
    https://doi.org/10.21832/9781788926317-011 [Google Scholar]
  30. Instituto Cervantes
    Instituto Cervantes (2020) El español en el mundo. Anuario del Instituto Cervantes 2020. Bala Perdida Editorial, Instituto Cervantes. https://cvc.cervantes.es/lengua/anuario/anuario_20/default.htm
    [Google Scholar]
  31. Kruger, J. y Dunning, D.
    (1999) Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121–1134. 10.1037/0022‑3514.77.6.1121
    https://doi.org/10.1037/0022-3514.77.6.1121 [Google Scholar]
  32. Lappin-Fortin, K. y Rye, B. J.
    (2014) The use of pre-/posttest and self -assessment tools in a French pronunciation course. Foreign Language Annals, 47(2), 300–320. 10.1111/flan.12083
    https://doi.org/10.1111/flan.12083 [Google Scholar]
  33. Levis, J.
    (2020) Revisiting the intelligibility and nativeness principles. Journal of Second Language Pronunciation, 6(3), 310–328. 10.1075/jslp.20050.lev
    https://doi.org/10.1075/jslp.20050.lev [Google Scholar]
  34. Lindsey, B. A. y Nagel, M. L.
    (2015) Do students know what they know? Exploring the accuracy of students’ self-assessments. Physical Review Special Topics Physics Education Research, 11(2), 1–11. 10.1103/PhysRevSTPER.11.020103
    https://doi.org/10.1103/PhysRevSTPER.11.020103 [Google Scholar]
  35. Ma, W. y Winke, P.
    (2019) Self-assessment: How reliable is it in assessing oral proficiency over time?Foreign Language Annals, 52(1), 66–86. 10.1111/flan.12379
    https://doi.org/10.1111/flan.12379 [Google Scholar]
  36. MacIntyre, P. D., Noels, K. A. y Clément, R.
    (1997) Biases in self-ratings of second language proficiency: The role of language anxiety. Language Learning, 47(2), 265–287. 10.1111/0023‑8333.81997008
    https://doi.org/10.1111/0023-8333.81997008 [Google Scholar]
  37. Mehrens, W. A. y Lehmann, I. J.
    (1991) Measurement and evaluation in education and psychology (4th ed.). Wadsworth/Thomson Learning.
    [Google Scholar]
  38. Moore, D. S. y Notz, W. I.
    (2009) Statistics. Concepts and controversies (7th ed.). W. H. Freeman & Company.
    [Google Scholar]
  39. Munro, M. J. y Derwing, T. M.
    (1995) Foreign accent, comprehensibility, and intelligibility in the speech of second language learners. Language Learning, 45(1), 73–97. 10.1111/j.1467‑1770.1995.tb00963.x
    https://doi.org/10.1111/j.1467-1770.1995.tb00963.x [Google Scholar]
  40. O’Brien, M. G.
    (2016) Methodological choices in rating speech samples. Studies in Second Language Acquisition, 38(03), 587–605. 10.1017/S0272263115000418
    https://doi.org/10.1017/S0272263115000418 [Google Scholar]
  41. Osle, Á.
    (2019) Estado de la enseñanza de la pronunciación en la clase ELE: situación actual en la escuela secundaria británica. RedELE: Revista Electrónica de Didáctica ELE, 311, 1–11.
    [Google Scholar]
  42. Pellegrino Aveni, V. A.
    (2005) Study abroad and second language use: Constructing the self. Cambridge University Press. 10.1017/CBO9780511620584
    https://doi.org/10.1017/CBO9780511620584 [Google Scholar]
  43. Préfontaine, Y.
    (2013) Perceptions of French fuency in second language speech production. Canadian Modern Language Review, 69(3), 324–348. 10.3138/cmlr.1748
    https://doi.org/10.3138/cmlr.1748 [Google Scholar]
  44. Rossiter, M. J., Derwing, T. M., Manimtim, L. G. y Thomson, R. I.
    (2010) Oral fluency: The neglected component in the communicative language classroom. Canadian Modern Language Review, 66(4), 583–606. 10.3138/cmlr.66.4.583
    https://doi.org/10.3138/cmlr.66.4.583 [Google Scholar]
  45. Saenz, G. D., Geraci, L., Miller, T. M. y Tirso, R.
    (2017) Metacognition in the classroom: The association between students’ exam predictions and their desired grades. Consciousness and Cognition, 511, 125–139. 10.1016/j.concog.2017.03.002
    https://doi.org/10.1016/j.concog.2017.03.002 [Google Scholar]
  46. Santamaría Busto, E.
    (2015) Percepción y evaluación de la pronunciación del español como L2. Revista Española de Lingüística, 45(1), 175–207. 10.31810/RSEL.45.1
    https://doi.org/10.31810/RSEL.45.1 [Google Scholar]
  47. (2020) Variables lingüísticas de la comprensibilidad, el acento extranjero y la fluidez en el español como L2. Diferencias en función del tipo de oyente y del grado de desempeño, Loquens, 7(2), 1–17. e075. 10.3989/loquens.2020.075
    https://doi.org/10.3989/loquens.2020.075 [Google Scholar]
  48. Saito, K., Trofimovich, P., Abe, M. e In’nami, Y.
    (2020) Dunning-Kruger effect in second language speech learning: How does self perception align with other perception over time?Learning and Individual Differences, 79(1), 1–10. 10.1016/j.lindif.2020.101849
    https://doi.org/10.1016/j.lindif.2020.101849 [Google Scholar]
  49. Saito, K., Trofimovich, P. y Isaacs, T.
    (2017) Using listener judgments to investigate linguistic influences on L2 comprehensibility and accentedness: A validation and generalization study. Applied Linguistics, 38(4), 439–462. 10.1093/applin/amv047
    https://doi.org/10.1093/applin/amv047 [Google Scholar]
  50. Schlösser, T., Dunning, D., Johnson, K. L. y Kruger, J.
    (2013) How unaware are the unskilled? Empirical tests of the “signal extraction” counterexplanation for the Dunning-Kruger effect in self-evaluation of performance. Journal of Economic Psychology, 391, 85–100. 10.1016/j.joep.2013.07.004
    https://doi.org/10.1016/j.joep.2013.07.004 [Google Scholar]
  51. Talsma, K., Schüz, B. y Norris, K.
    (2019) Miscalibration of self-efficacy and academic performance: Self-efficacy ≠ self-fulfilling prophecy. Learning and Individual Differences, 69(1), 182–195. 10.1016/j.lindif.2018.11.002
    https://doi.org/10.1016/j.lindif.2018.11.002 [Google Scholar]
  52. Tan, H. K. K., Teo, C. T. y Ng, C. S.
    (2011) Variation in students’ conceptions of self-assessment and standards. Education Research International, 2011, 1–9. 10.1155/2011/487130
    https://doi.org/10.1155/2011/487130 [Google Scholar]
  53. Thomson, R. I.
    (2015) Fluency. EnM. Reed y J. M. Levis (Eds.), The handbook of English pronunciation (pp.209–226). John Wiley & Sons. 10.1002/9781118346952.ch12
    https://doi.org/10.1002/9781118346952.ch12 [Google Scholar]
  54. Thorndike, R. M.
    (1997) Measurement and evaluation in psychology and education (6th ed.). Prentice Hall.
    [Google Scholar]
  55. Trofimovich, P. y Isaacs, T.
    (2012) Disentangling accent from comprehensibility. Bilingualism: Language and Cognition, 15(4), 905–916. 10.1017/S1366728912000168
    https://doi.org/10.1017/S1366728912000168 [Google Scholar]
  56. Trofimovich, P., Isaacs, T., Kennedy, S., Saito, K. y Crowther, D.
    (2016) Flawed selfassessment: Investigating self- and other-perception of second language speech. Bilingualism: Language and Cognition, 19(1), 122–140. 10.1017/S1366728914000832
    https://doi.org/10.1017/S1366728914000832 [Google Scholar]
  57. Walker, R.
    (2005) Using student-produced recordings with monolingual groups to provide effective, individualized pronunciation practice. TESOL Quarterly, 39(3), 550–558. 10.2307/3588495
    https://doi.org/10.2307/3588495 [Google Scholar]
  58. Yoshida, M. T.
    (2018) Choosing technology tools to meet pronunciation teaching and learning goals. The CATESOL Journal, 30(1), 195–212.
    [Google Scholar]
  59. Zimmerman, D. W. y Zumbo, B. D.
    (2005) Can percentiles replace raw scores in the statistical analysis of test data?Educational and Psychological Measurement, 65(4), 616–638. 10.1177/0013164404272499
    https://doi.org/10.1177/0013164404272499 [Google Scholar]
http://instance.metastore.ingenta.com/content/journals/10.1075/resla.21023.san
Loading
/content/journals/10.1075/resla.21023.san
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error