1887
  1. Home
  2. e-Journals
  3. ITL - International Journal of Applied Linguistics
  4. Online First Articles
  5. Online First Article
image of Development and initial validation of a yes/no vocabulary test for North Sámi
EPUB
PDF

Abstract

Abstract

This paper accounts for the development and initial validation of a yes/no vocabulary test of North Sámi called North Sámi Vocabulary Test (NSVT). North Sámi (NS) is an Indigenous language spoken in northern Scandinavia. Being an endangered language, NS is in need of revitalisation efforts. One contribution is the provision of proficiency assessment tools. We administered a 75-item NSVT version (50 real verbs and 25 pseudoverbs) to users of North Sámi in Sweden and Norway ( = 289). Evidence of high item- and person-based reliability and separation indices were observed, as well as support for a number of validity facets. High correlations existed between NSVT scores and self-reported and rated spoken proficiency. The NSVT provides quick and reliable assessment of vocabulary knowledge and an indication of overall language proficiency in North Sámi.

© John Benjamins Publishing Company
Available under the CC BY 4.0 license.
Loading

Article metrics loading...

/content/journals/10.1075/itl.23005.gyl
2024-08-05
2024-09-19

  • From This Site

    /content/journals/10.1075/itl.23005.gyl
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

/deliver/fulltext/10.1075/itl.23005.gyl/itl.23005.gyl.html?itemId=/content/journals/10.1075/itl.23005.gyl&mimeType=html&fmt=ahah

References

  1. Aikio-Puoskari, U.
    (2018) Revitalization of Sámi languages in three nordic countries: Finland, Norway, and Sweden. InL. Hinton, L. Huss, & G. Roche (Eds.), The Routledge Handbook of Language Revitalization (pp.–). Routledge. 10.4324/9781315561271‑45
     https://doi.org/10.4324/9781315561271-45 [Google Scholar]
  2. Albury, N. J.
    (2016) Holding them at arm’s length: A critical review of Norway’s policy on Sámi language maintenance. Journal of Home Language Research, , –. 10.16993/jhlr.25
     https://doi.org/10.16993/jhlr.25 [Google Scholar]
  3. Alderson, C.
    (2005) Diagnosing foreign language proficiency. Continuum.
     [Google Scholar]
  4. Amenta, S., Badan, L., & Brysbaert, M.
    (2021) LexITA: A quick and reliable assessment tool for Italian L2 receptive vocabulary size. Applied Linguistics, (), –. 10.1093/applin/amaa020
     https://doi.org/10.1093/applin/amaa020 [Google Scholar]
  5. Aryadoust, V., Ng, L. Y., & Sayama, H.
    (2021) A comprehensive review of Rasch measurement in language assessment: Recommendations and guidelines for research. Language Testing, (), –. 10.1177/0265532220927487
     https://doi.org/10.1177/0265532220927487 [Google Scholar]
  6. Beeckmans, R., Eyckmans, J., Janssens, V., Dufranne, M., & Van de Velde, H.
    (2001) Examining the yes/no vocabulary test: Some methodological issues in theory and practice. Language Testing, (), –. 10.1177/026553220101800301
     https://doi.org/10.1177/026553220101800301 [Google Scholar]
  7. Beglar, D.
    (2010) A Rasch-based validation of the Vocabulary Size Test. Language Testing, (), –. 10.1177/0265532209340194
     https://doi.org/10.1177/0265532209340194 [Google Scholar]
  8. Belančić, K.
    (2020) Language policy and Sámi education in Sweden: ideological and implementational spaces for Sámi language use [Unpublished PhD thesis]. Umeå University.
     [Google Scholar]
  9. Belančić, K., & Lindgren, E.
    (2017) Discourses of functional bilingualism in the Sámi curriculum in Sweden. International Journal of Bilingual Education and Bilingualism, (), –. 10.1080/13670050.2017.1396283
     https://doi.org/10.1080/13670050.2017.1396283 [Google Scholar]
  10. Bond, T. G., & Fox, C. M.
    (2007) Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). Lawrence Erlbaum Associates.
     [Google Scholar]
  11. Brysbaert, M.
    (2013) Lextale_FR a fast, free, and efficient test to measure language proficiency in French. Psychologica Belgica, (), –. 10.5334/pb‑53‑1‑23
     https://doi.org/10.5334/pb-53-1-23 [Google Scholar]
  12. Duncan, P. W., Bode, R. K., Lai, S. M., & Perera, S.
    (2003) Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale. Archives of Physical Medicine and Rehabilitation, , –. 10.1016/S0003‑9993(03)00035‑2
     https://doi.org/10.1016/S0003-9993(03)00035-2 [Google Scholar]
  13. Eberhard, D. M., Simons, G. F., & Fennig, C. D.
    (2022) Ethnologue: Languages of the World. 25th Edition. SIL International. Available at: www.ethnologue.com
     [Google Scholar]
  14. Eyckmans, J.
    (2004) Measuring receptive vocabulary size. LOT.
     [Google Scholar]
  15. Ferin, M., Gyllstad, H., Venagli, I., Zordan, A., & Kupisch, T.
    (2023) LexVEN: A quick vocabulary test for proficiency in Venetan. Isogloss, (), –. 10.5565/rev/isogloss.374
     https://doi.org/10.5565/rev/isogloss.374 [Google Scholar]
  16. Giellatekno – Saami Language Technology, UiT The Arctic University of Norway and The Divvun group at UiT The Arctic University of Norway
    Giellatekno – Saami Language Technology, UiT The Arctic University of Norway and The Divvun group at UiT The Arctic University of Norway (2015) SIKOR North Saami free corpus, Common Language Resources and Technology Infrastructure Norway (CLARINO) Bergen Repository. hdl.handle.net/11509/100
  17. Green, R.
    (2013) Statistical analyses for language testers. Routledge. 10.1057/9781137018298
     https://doi.org/10.1057/9781137018298 [Google Scholar]
  18. Green, D. M., & Swets, J. A.
    (1966) Signal detection theory and psychophysics. New York: Wiley.
     [Google Scholar]
  19. Grenoble, L. A., & Osipov, B.
    (2023) The dynamics of bilingualism in language shift ecologies. Linguistic Approaches to Bilingualism, (), –. 10.1075/lab.22035.gre
     https://doi.org/10.1075/lab.22035.gre [Google Scholar]
  20. Gyllstad, H.
    (2007) Testing English collocations: Developing receptive tests for use with advanced Swedish learners [Unpublished PhD Thesis]. Lund University.
     [Google Scholar]
  21. (2013) Looking at L2 vocabulary knowledge dimensions from an assessment perspective: Challenges and potential solutions. InC. Bardel, C. Lindqvist, & B. Laufer (Eds.), L2 vocabulary acquisition, knowledge and use. New perspectives on assessment and corpus analysis (pp.–). Eurosla Monograph Series 2. European Association of Second Language Acquisition.
     [Google Scholar]
  22. (2020) Measuring knowledge of multiword items. InS. Webb (Ed.), The Routledge Handbook of Vocabulary Studies (pp.–). Routledge.
     [Google Scholar]
  23. Gyllstad, H., Vilkaitė, L., & Schmitt, N.
    (2015) Assessing vocabulary size through multiple-choice formats: Issues with guessing and sampling rates. ITL International Journal of Applied Linguistics, (), –. 10.1075/itl.166.2.04gyl
     https://doi.org/10.1075/itl.166.2.04gyl [Google Scholar]
  24. Gyllstad, H., McLean, S., & Stewart, J.
    (2021) Using confidence intervals to determine adequate item sample sizes for vocabulary tests: An essential but overlooked practice. Language Testing, (), –. 10.1177/0265532220979562
     https://doi.org/10.1177/0265532220979562 [Google Scholar]
  25. Harrington, M., & Carey, M.
    (2009) The on-line Yes/No test as a placement tool. System, (), –. 10.1016/j.system.2009.09.006
     https://doi.org/10.1016/j.system.2009.09.006 [Google Scholar]
  26. Hashimoto, B. J.
    (2021) Is frequency enough?: The frequency model in vocabulary size testing. Language Assessment Quarterly, (), –. 10.1080/15434303.2020.1860058
     https://doi.org/10.1080/15434303.2020.1860058 [Google Scholar]
  27. Henning, G.
    (1987) A guide to language testing. Heinle and Heinle.
     [Google Scholar]
  28. Hirvonen, V.
    (2008) ‘Out on the fells, I feel like a Sámi’: Is There Linguistic and Cultural Equality in the Sámi School?InN. Hornberger (Ed.), Can schools save indigenous languages? (pp.–). Palgrave Macmillan. 10.1057/9780230582491_2
     https://doi.org/10.1057/9780230582491_2 [Google Scholar]
  29. Huibregtse, I., Admiraal, W., & Meara, P.
    (2002) Scores on a yes–no vocabulary test: Correction for guessing and response style. Language Testing, (), –. 10.1191/0265532202lt229oa
     https://doi.org/10.1191/0265532202lt229oa [Google Scholar]
  30. Izura, C., Cuetos, F., & Brysbaert, M.
    (2014) Lextale-Esp: A test to rapidly and efficiently assess the Spanish vocabulary size. Psicológica, (), –.
     [Google Scholar]
  31. Knoch, U., & McNamara, T.
    (2015) Rasch analysis. InL. Plonsky (Ed.), Advancing quantitative methods in second language research (pp.–). Routledge. 10.4324/9781315870908‑12
     https://doi.org/10.4324/9781315870908-12 [Google Scholar]
  32. Kupisch, T., Arona, S., Besler, A., Cruschina, S., Ferin, M., Gyllstad, H., & Venagli, I.
    (2023) LexSIC: A quick vocabulary test for proficiency in Sicilian. Isogloss, (), –. 10.5565/rev/isogloss.302
     https://doi.org/10.5565/rev/isogloss.302 [Google Scholar]
  33. Leiner, D. J.
    (2014) SoSci Survey (Version 2.4.00-i). [Computer software].
     [Google Scholar]
  34. Lemhöfer, K., & Broersma, M.
    (2012) Introducing LexTALE: A quick and valid lexical test for advanced learners of English. Behavior Research Methods, (), –. 10.3758/s13428‑011‑0146‑0
     https://doi.org/10.3758/s13428-011-0146-0 [Google Scholar]
  35. Linacre, J. M.
    (2002) What do infit and outfit, mean-square and standardized mean. Rasch Measurement Transactions, (), .
     [Google Scholar]
  36. (2018, 3Sep.). Detecting multidimensionality in Rasch data using Winsteps Table [Video]. YouTube. https://youtu.be/sna19QemE50
     [Google Scholar]
  37. (2021a) Winsteps® Rasch measurement computer program (Version 5.1.6). Winsteps.com
     [Google Scholar]
  38. (2021b) A user’s guide to Winsteps® Ministep Rasch-model computer programs (Program manual 5.1.6). Winsteps.com
     [Google Scholar]
  39. Lloyd-Smith, A., Bergman, F., Sapir, Y., Yasar, R., & Kupisch, T.
    (2023a) Why language matters. Inequality perceptions among the in Sweden and Norway. Policy Paper 11, Policy Papers of the Cluster “The Politics of Inequality”.
     [Google Scholar]
  40. Lloyd-Smith, A., Bergman, F., Hund, L., & Kupisch, T.
    (2023b) Can policies improve language vitality? The Sámi languages in Sweden and Norway. Frontiers in Psychology, . 10.3389/fpsyg.2023.1059696
     https://doi.org/10.3389/fpsyg.2023.1059696 [Google Scholar]
  41. McIvor, O.
    (2020) Indigenous Language Revitalization and Applied Linguistics: Parallel Histories, Shared Futures?Annual Review of Applied Linguistics, , –. 10.1017/S0267190520000094
     https://doi.org/10.1017/S0267190520000094 [Google Scholar]
  42. McIvor, O., & Jacobs, P.
    (2016) NETOLNEW Language Learning Assessment Tool (v3.1). Retrieved from: https://www.uvic.ca/research/partner/home/projects/language-assessment-tool/index.php
  43. McLean, S., Kramer, B., & Beglar, D.
    (2015) The creation and validation of a listening vocabulary levels test. Language Teaching Research, (), –. 10.1177/1362168814567889
     https://doi.org/10.1177/1362168814567889 [Google Scholar]
  44. Meara, P.
    (1996) The dimensions of lexical competence. InG. Brown, K. Malmkjær, & J. Williams (Eds.), Performance and competence in second language acquisition (pp.–). Cambridge University Press.
     [Google Scholar]
  45. Meara, P. M., & Buxton, B.
    (1987) An alternative to multiple choice vocabulary tests. Language Testing, (), –. 10.1177/026553228700400202
     https://doi.org/10.1177/026553228700400202 [Google Scholar]
  46. Meara, P., & Miralpeix, I.
    (2017) Tools for researching vocabulary. Multilingual Matters.
     [Google Scholar]
  47. Mercator European Research Centre on Multilingualism and Language Learning
    Mercator European Research Centre on Multilingualism and Language Learning (2020) SÁMI. The Sámi language in education in Sweden.
     [Google Scholar]
  48. Messick, S.
    (1989) Validity. InR. L. Linn (Ed.), Educational measurement (pp.–). American Council on education and Macmillan.
     [Google Scholar]
  49. (1995) Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, (), –. 10.1037/0003‑066X.50.9.741
     https://doi.org/10.1037/0003-066X.50.9.741 [Google Scholar]
  50. Milton, J., Wade, J., & Hopkins, N.
    (2010) Aural word recognition and oral competence in English as a foreign language. InR. Chacón-Beltrán, C. Abello-Contesse, & M. del Mar Torreblanca-López (Eds.), Insights into non-native vocabulary teaching and learning (pp.–). Multilingual Matters. 10.21832/9781847692900‑007
     https://doi.org/10.21832/9781847692900-007 [Google Scholar]
  51. Min, S., & Aryadoust, V.
    (2021) A systematic review of item response theory in language assessment: Implications for the dimensionality of language ability. Studies in Educational Evaluation, , 100963. 10.1016/j.stueduc.2020.100963
     https://doi.org/10.1016/j.stueduc.2020.100963 [Google Scholar]
  52. Minde, H.
    (2003) Assimilation of the Sami: Implementation and consequences. Acta Borealia, , –. 10.1080/08003830310002877
     https://doi.org/10.1080/08003830310002877 [Google Scholar]
  53. Mochida, K., & Harrington, M.
    (2006) The Yes/No test as a measure of receptive vocabulary knowledge. Language Testing, (), –. 10.1191/0265532206lt321oa
     https://doi.org/10.1191/0265532206lt321oa [Google Scholar]
  54. Nakata, T., Tamura, Y., & Aubrey, S.
    (2020) Examining the validity of the LexTALE test for Japanese college students. The journal of Asia TEFL, (), –.
     [Google Scholar]
  55. Nicklin, C., & Vitta, J. P.
    (2022) Assessing Rasch measurement estimation methods across R packages with yes/no vocabulary test data. Language Testing, (), –. 10.1177/02655322211066822
     https://doi.org/10.1177/02655322211066822 [Google Scholar]
  56. Nation, P., & Beglar, D.
    (2007) A vocabulary size test. The Language Teacher, (), –.
     [Google Scholar]
  57. Ockey, G.
    (2017) Item response theory. InG. Fulcher, & F. Davidson (Eds.), The Routledge Handbook of Language Testing (pp.–). Routledge.
     [Google Scholar]
  58. Outakoski, H.
    (2015) Multilingual Literacy among Young Learners of North Sámi: Contexts, Complexity and Writing in Sápmi. Department of language studies, Umeå University.
     [Google Scholar]
  59. Pellicer-Sánchez, A., & Schmitt, N.
    (2012) Scoring Yes–No vocabulary tests: Reaction time vs. nonword approaches. Language Testing, (), –. 10.1177/0265532212438053
     https://doi.org/10.1177/0265532212438053 [Google Scholar]
  60. Plonsky, L.
    (2023) Sampling and generalizability in Lx research: A second-order synthesis. Languages, (), . 10.3390/languages8010075
     https://doi.org/10.3390/languages8010075 [Google Scholar]
  61. Plonsky, L., & Oswald, F. L.
    (2014) How big is “big”? Interpreting effect sizes in L2 research. Language Learning, (), –. 10.1111/lang.12079
     https://doi.org/10.1111/lang.12079 [Google Scholar]
  62. Rasmussen, T., & Nolan, J. S.
    (2011) Reclaiming Sámi languages: Indigenous language emancipation from East to West. International Journal of the Sociology of Language, , –. 10.1515/ijsl.2011.020
     https://doi.org/10.1515/ijsl.2011.020 [Google Scholar]
  63. Salminen, T.
    (2007) Europe and North Asia. InC. Moseley (Ed.), Encyclopedia of the World’s Endangered Languages (pp.–). Routledge.
     [Google Scholar]
  64. Salmela, R., Lehtonen, M., Garusi, S., & Bertram, R.
    (2021) Lexize: A test to quickly assess vocabulary knowledge in Finnish. Scandinavian Journal of Psychology, (), –. 10.1111/sjop.12768
     https://doi.org/10.1111/sjop.12768 [Google Scholar]
  65. Schmitt, N., Schmitt, D., & Clapham, C.
    (2001) Developing and exploring the behaviour of two new versions of the Vocabulary Levels Test. Language Testing, (), –. 10.1177/026553220101800103
     https://doi.org/10.1177/026553220101800103 [Google Scholar]
  66. Solstad, K. J., Balto, A. M. V., Nygaard, V., Jodesfsen, E., & Solstad, M.
    (2012) Samisk Sprakundersokelne ().
     [Google Scholar]
  67. Staehr, L. S.
    (2008) Vocabulary size and the skills of listening, reading and writing. Language Learning Journal, (), –. 10.1080/09571730802389975
     https://doi.org/10.1080/09571730802389975 [Google Scholar]
  68. Stanislaw, H., & Todorov, N.
    (1999) Calculation of signal detection theory measures. Behavior Research Methods, Instruments and Computers, (), –. 10.3758/BF03207704
     https://doi.org/10.3758/BF03207704 [Google Scholar]
  69. Stubbe, R.
    (2012) Do pseudoword false alarm rates and overestimation rates in yes–no vocabulary tests change with Japanese university students’ ability levels?Language Testing, (), –. 10.1177/0265532211433033
     https://doi.org/10.1177/0265532211433033 [Google Scholar]
  70. Trosterud, T.
    (2008) Language assimilation during the modernisation process: Experiences from Norway and north-west Russia. Acta Borealia, (), –. 10.1080/08003830802496653
     https://doi.org/10.1080/08003830802496653 [Google Scholar]
  71. Uchihara, T., & Clenton, J.
    (2020) Investigating the role of vocabulary size in second language speaking ability. Language Teaching Research, (), –. 10.1177/1362168818799371
     https://doi.org/10.1177/1362168818799371 [Google Scholar]
  72. Vangsnes, Ø.
    (2019, December13–16). A prognosis for Sámi in Norway: School as key to revitalization [Conference presentation]. Foundation for Endangered Languages XXIII, University of Sydney, Australia. https://app.cristin.no/results/show.jsf?id=1761574
     [Google Scholar]
  73. Yanagisawa, A., & Webb, S.
    (2020) Measuring depth of vocabulary knowledge. InS. Webb (Ed.), The Routledge Handbook of Vocabulary Studies (pp.–). Routledge.
     [Google Scholar]
  74. Zhang, X., Liu, J., & Ai, H.
    (2020) Pseudowords and guessing in the Yes/No format vocabulary Test. Language Testing, (), –. 10.1177/0265532219862265
     https://doi.org/10.1177/0265532219862265 [Google Scholar]
  75. Zimmerman, J., Broder, P. K., Shaughnessy, J. J., & Underwood, B. J.
    (1977) A recognition test of vocabulary using signal-detection measures and some correlates of word and non-word recognition. Intelligence, (), –. 10.1016/0160‑2896(77)90025‑3
     https://doi.org/10.1016/0160-2896(77)90025-3 [Google Scholar]
/content/journals/10.1075/itl.23005.gyl
Loading
Development and initial validation of a yes/no vocabulary test for North Sámi
John Benjamins ; https://doi.org/10.1075/itl.23005.gyl
/content/journals/10.1075/itl.23005.gyl
/content/journals/10.1075/itl.23005.gyl
Loading

Data & Media loading...

  • Article Type: Research Article
Keywords: language proficiency ; Rasch ; Item Response Theory ; yes/no test ; vocabulary ; Indigenous language ; Signal Detection Theory ; North Sámi

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error