1887
  1. Home
  2. e-Journals
  3. Applied Pragmatics
  4. Volume 6, Issue 2
  5. Article
Volume 6, Issue 2
  • ISSN 2589-109X
  • E-ISSN: 2589-1103
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Pragmatic and interactional abilities are represented in major models of second language (L2) communicative competence (Bachman & Palmer, 2010; Canale & Swain, 1980), which provide the framework for L2 assessment. However, pragmatics and interaction are only rarely tested in major operational tests. This is despite a significant amount of work in the testing of L2 pragmatics and interaction since the mid-1990s. This paper outlines current work on testing of L2 pragmatics, which broadly follows two traditions, one informed by speech act theory, politeness theory and philosophical pragmatics, and the other by conversation analysis and sociology. It also discusses reasons for the limited uptake of pragmatics assessment by large-scale tests, including low practicality, limited stakeholder test literacy, and broader challenges in testing pragmatics. It concludes by suggesting ways of overcoming these obstacles and thereby achieving better construct representation in L2 tests.

© 2024 John Benjamins Publishing Company
Loading

Article metrics loading...

/content/journals/10.1075/ap.00022.roe
2025-02-07
2026-04-10

  • From This Site

    /content/journals/10.1075/ap.00022.roe
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Austin, J. L.
    (1962) How to do things with words. Oxford University Press.
     [Google Scholar]
  2. Bachman, L. F., & Palmer, A. S.
    (2010) Language assessment in practice: Developing language tests and justifying their use in the real world. Oxford University Press.
     [Google Scholar]
  3. Bardovi-Harlig, K.
    (2009) Conventional expressions as a pragmalinguistic resource: Recognition and production of conventional expressions in L2 pragmatics. Language Learning, 591, 755–795. 10.1111/j.1467‑9922.2009.00525.x
     https://doi.org/10.1111/j.1467-9922.2009.00525.x [Google Scholar]
  4. Bouton, L. F.
    (1999) Developing non-native speaker skills in interpreting conversational Implicatures in English: Explicit teaching can ease the process. InE. Hinkel (Ed.), Culture in second language teaching and learning (pp.47–70). Cambridge University Press.
     [Google Scholar]
  5. Brown, J. D., & Ahn, R. C.
    (2011) Variables that affect the dependability of L2 pragmatics tests. Journal of Pragmatics, 43(1), 198–217. 10.1016/j.pragma.2010.07.026
     https://doi.org/10.1016/j.pragma.2010.07.026 [Google Scholar]
  6. Brown, P., & Levinson, S. C.
    (1987) Politeness: Some universals in language usage. Cambridge University Press. 10.1017/CBO9780511813085
     https://doi.org/10.1017/CBO9780511813085 [Google Scholar]
  7. Canale, M., & Swain, M.
    (1980) Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics, 11, 1–47. 10.1093/applin/1.1.1
     https://doi.org/10.1093/applin/1.1.1 [Google Scholar]
  8. Chinese Testing International
    Chinese Testing International (2018) About test. www.chinesetest.cn/gosign.do?id=1&lid=0
  9. Cogo, A., & House, J.
    (2017) The pragmatics of ELF. InJ. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp.210–223). Routledge. 10.4324/9781315717173‑18
     https://doi.org/10.4324/9781315717173-18 [Google Scholar]
  10. Cook, H. M.
    (2001) Why can’t learners of Japanese as a foreign language distinguish polite from impolite speech styles?InK. Rose & G. Kasper (Eds.), Pragmatics in language teaching (pp.80–102). Cambridge University Press. 10.1017/CBO9781139524797.009
     https://doi.org/10.1017/CBO9781139524797.009 [Google Scholar]
  11. Coulmas, F.
    (1981) Conventional routine: Exploration in standardized communication situations and prepatterned speech. Mouton.
     [Google Scholar]
  12. Council of Europe
    Council of Europe (2020) Common European framework of reference for languages: Learning, teaching, assessment. Companion volume with new descriptors. Council of Europe. https://www.coe.int/en/web/common-european-framework-reference-languages
     [Google Scholar]
  13. Dai, D. W.
    (2024) Assessing interactional competence. Peter Lang.
     [Google Scholar]
  14. Educational Testing Service
    Educational Testing Service (2020) TOEFL iBT speaking section. https://www.ets.org/toefl/test-takers/ibt/about/content/speaking/
     [Google Scholar]
  15. Educational Testing Service
    Educational Testing Service (2021) The TOEIC tests. https://www.ets.org/toeic/test-takers
     [Google Scholar]
  16. Ellis, R., & Roever, C.
    (2021) The measurement of implicit and explicit knowledge. The Language Learning Journal, 49(2), 160–175. 10.1080/09571736.2018.1504229
     https://doi.org/10.1080/09571736.2018.1504229 [Google Scholar]
  17. Ellis, R., Zhu, Y., Shintani, N., & Roever, C.
    (2021) A study of Chinese learners’ ability to comprehend irony. Journal of Pragmatics, 1721, 7–20. 10.1016/j.pragma.2020.11.003
     https://doi.org/10.1016/j.pragma.2020.11.003 [Google Scholar]
  18. Félix-Brasdefer, J. C.
    (2019) Speech acts in interaction: Negotiating joint action in a second language. InN. Taguchi (Ed.), The Routledge handbook of second language acquisition and pragmatics (pp.17–30). Routledge.
     [Google Scholar]
  19. Galaczi, E. D.
    (2014) Interactional competence across proficiency levels: How do learners manage interaction in paired speaking tests?Applied Linguistics, 35(5), 553–574. 10.1093/applin/amt017
     https://doi.org/10.1093/applin/amt017 [Google Scholar]
  20. Galaczi, E., & Taylor, L.
    (2018) Interactional competence: Conceptualisations, operationalisations, and outstanding questions. Language Assessment Quarterly, 15(3), 219–236. 10.1080/15434303.2018.1453816
     https://doi.org/10.1080/15434303.2018.1453816 [Google Scholar]
  21. Golato, A.
    (2003) Studying compliment responses: A comparison of DCTs and recordings of naturally occurring talk. Applied Linguistics, 24(1), 90–121. 10.1093/applin/24.1.90
     https://doi.org/10.1093/applin/24.1.90 [Google Scholar]
  22. Grabowski, K.
    (2009) Investigating the construct validity of a test designed to measure grammatical and pragmatic knowledge in the context of speaking [Unpublished doctoral dissertation]. Teachers College, Columbia University.
  23. (2013) Investigating the construct validity of a role-play test designed to measure grammatical and pragmatic knowledge at multiple proficiency levels. InS. Ross & G. Kasper (Eds.), Assessing second language pragmatics (pp.149–171). Palgrave Macmillan. 10.1057/9781137003522_6
     https://doi.org/10.1057/9781137003522_6 [Google Scholar]
  24. Grice, H. P.
    (1975) Logic and conversation. InP. Cole & J. L. Morgan (Eds.), Syntax and semantics 3: Speech acts (pp.41–58). Academic Press. 10.1163/9789004368811_003
     https://doi.org/10.1163/9789004368811_003 [Google Scholar]
  25. Hall, J. K., & Pekarek Doehler, S.
    (2011) L2 interactional competence and development. InJ. K. Hall, J. Hellermann, & S. Pekarek Doehler (Eds.), L2 interactional competence and development (pp.1–15). Multilingual Matters. 10.21832/9781847694072‑003
     https://doi.org/10.21832/9781847694072-003 [Google Scholar]
  26. Harding, L. W., & McNamara, T.
    (2018) Language assessment: The challenge of ELF. InJ. Jenkins, W. Baker, & M. Dewey (Eds.), The Routledge handbook of English as a lingua franca (pp.570–582). Routledge.
     [Google Scholar]
  27. Hepburn, A., & Potter, J.
    (2021) Essentials of conversation analysis. American Psychological Association. 10.1037/0000251‑000
     https://doi.org/10.1037/0000251-000 [Google Scholar]
  28. Hudson, T., Detmer, E., & Brown, J. D.
    (1995) Developing prototypic measures of cross-cultural pragmatics (Technical report #7). University of Hawai’i, Second Language Teaching and Curriculum Center.
     [Google Scholar]
  29. Hymes, D.
    (1972) On communicative competence. InJ. Pride & J. Holmes (Eds.), Sociolinguistics: Selected readings (pp.269–293). Penguin.
     [Google Scholar]
  30. Ikeda, N.
    (2017) Measuring L2 oral pragmatic abilities for use in social contexts: Development and validation of an assessment instrument for L2 pragmatics performance in university settings [Unpublished doctoral dissertation]. The University of Melbourne.
  31. (2021) Assessing L2 learners’ pragmatic ability in problem-solving situations at English-medium university. Applied Pragmatics, 3(1), 51–83. 10.1075/ap.19039.ike
     https://doi.org/10.1075/ap.19039.ike [Google Scholar]
  32. Itomitsu, M.
    (2009) Developing a test of pragmatics of Japanese as a foreign language (Publication No. osu1250512327) [Doctoral dissertation, Ohio State University]. OhioLINK ETD Center. rave.ohiolink.edu/etdc/view?acc_num=osu1250512327
  33. Jacoby, S., & McNamara, T.
    (1999) Locating competence. English for Specific Purposes, 18(3), 213–241. 10.1016/S0889‑4906(97)00053‑7
     https://doi.org/10.1016/S0889-4906(97)00053-7 [Google Scholar]
  34. Kasper, G.
    (2006) Speech acts in interaction: Towards discursive pragmatics. InK. Bardovi-Harlig, J. C. Félix-Brasdefer, & A. S. Omar (Eds.), Pragmatics & language learning (Vol.111, pp.281–314). National Foreign Language Resource Center.
     [Google Scholar]
  35. Lam, D. M. K.
    (2018) What counts as “responding”? Contingency on previous speaker contribution as a feature of interactional competence. Language Testing, 35(3), 377–401. 10.1177/0265532218758126
     https://doi.org/10.1177/0265532218758126 [Google Scholar]
  36. Liu, J.
    (2006) Measuring interlanguage pragmatic knowledge of EFL learners. Peter Lang.
     [Google Scholar]
  37. Messick, S.
    (1989) Validity. InR. L. Linn (Ed.), Educational measurement (3rd ed., pp.13–103). American Council on Education/Macmillan.
     [Google Scholar]
  38. Ockey, G. J., & Chukharev-Hudilainen, E.
    (2021) Human versus computer partner in the paired oral discussion test. Applied Linguistics, 1–21. 10.1093/applin/amaa067
     https://doi.org/10.1093/applin/amaa067 [Google Scholar]
  39. OET
    OET (2018) Speaking assessment criteria and level descriptors. https://prod-wp-content.occupationalenglishtest.org/resources/uploads/2018/08/22102547/speaking-assessment-criteria-updated-2018.pdf
  40. Pekarek Doehler, S.
    (2019) On the nature and the development of L2 interactional competence: State of the art and implications for praxis. InM. R. Salaberry & S. Kunitz (Eds.), Teaching and testing L2 interactional competence: Bridging theory and practice (pp.25–59). Routledge. 10.4324/9781315177021‑2
     https://doi.org/10.4324/9781315177021-2 [Google Scholar]
  41. Pill, J.
    (2016) Drawing on indigenous criteria for more authentic assessment in a specific-purpose language test: Health professionals interacting with patients. Language Testing, 33(2), 175–193. 10.1177/0265532215607400
     https://doi.org/10.1177/0265532215607400 [Google Scholar]
  42. Purpura, J. E.
    (2004) Assessing grammar. Cambridge University Press. 10.1017/CBO9780511733086
     https://doi.org/10.1017/CBO9780511733086 [Google Scholar]
  43. Roever, C.
    (2005) Testing ESL pragmatics. Peter Lang. 10.3726/978‑3‑653‑04780‑6
     https://doi.org/10.3726/978-3-653-04780-6 [Google Scholar]
  44. (2013) Testing implicature under operational conditions. InG. Kasper & S. Ross (Eds.), Assessing second language pragmatics (pp.43–64). Palgrave Macmillan. 10.1057/9781137003522_2
     https://doi.org/10.1057/9781137003522_2 [Google Scholar]
  45. Roever, C., & Dai, W.
    (2021) Interactional competence and language testing. InM. R. Salaberry & R. Burch (Eds.), Assessing speaking (pp.23–49). Palgrave Macmillan. 10.21832/9781788923828‑003
     https://doi.org/10.21832/9781788923828-003 [Google Scholar]
  46. Roever, C., & Ellis, R.
    (2021) Testing implicit pragmatic knowledge. InC. Félix-Brasdefer, R. Shively, & J. Sykes (Eds.), New directions in researching, teaching, and assessing L2 pragmatics (pp.142–155). Mouton de Gruyter.
     [Google Scholar]
  47. Roever, C., Fraser, C., & Elder, C.
    (2014) Testing ESL sociopragmatics: Development and validation of a web-based test battery. Peter Lang. 10.3726/978‑3‑653‑04598‑7
     https://doi.org/10.3726/978-3-653-04598-7 [Google Scholar]
  48. Roever, C., Higuchi, Y., Sasaki, M., Yashima, T., & Nakamuro, M.
    (2023) Validating a test of L2 routine formulae to detect pragmatics learning in stays abroad. Applied Pragmatics, 5(1), 41–63. 10.1075/ap.20015.roe
     https://doi.org/10.1075/ap.20015.roe [Google Scholar]
  49. Roever, C., & Ikeda, N.
    (2022) What scores from monologic speaking tests can (not) tell us about interactional competence. Language Testing, 39(1), 7–29. 10.1177/02655322211003332
     https://doi.org/10.1177/02655322211003332 [Google Scholar]
  50. Ross, S., & Zheng, Q.
    (2021) Strategic competence and pragmatic proficiency in L2 role plays. InJ. C. Félix-Brasdefer & R. L. Shively (Eds.), New directions in second language pragmatics (pp.179–194). De Gruyter. 10.1515/9783110721775‑013
     https://doi.org/10.1515/9783110721775-013 [Google Scholar]
  51. Saito, J.
    (2018) “Sarariiman” and the performance of masculinities at work: An analysis of interactions at business meetings at a multinational corporation in Japan. InH. Cook & J. Shibamoto-Smith (Eds.), Japanese at work (pp.97–121). Springer. 10.1007/978‑3‑319‑63549‑1_5
     https://doi.org/10.1007/978-3-319-63549-1_5 [Google Scholar]
  52. Sato, T., & McNamara, T.
    (2019) What counts in second language oral communication ability? The perspective of linguistic laypersons. Applied Linguistics, 40(6), 894–916. 10.1093/applin/amy032
     https://doi.org/10.1093/applin/amy032 [Google Scholar]
  53. Searle, J. R.
    (1969) Speech acts: An essay in the philosophy of language. Cambridge University Press. 10.1017/CBO9781139173438
     https://doi.org/10.1017/CBO9781139173438 [Google Scholar]
  54. Tada, M.
    (2005) Assessment of ESL pragmatic production and perception using video prompts [Unpublished doctoral dissertation]. Temple University.
  55. Tajeddin, Z., Alemi, M., & Khanlarzadeh, N.
    (2021) Rating criteria and norms for pragmatic assessment in the context of EIL. InZ. Tajeddin & M. Alemi (Eds.), Pragmatics pedagogy in English as an international language (pp.212–231). Routledge.
     [Google Scholar]
  56. Timpe-Laughlin, V., & Choi, I.
    (2017) Exploring the validity of a second intercultural pragmatics assessment tool. Language Assessment Quarterly, 14(1), 19–35. 10.1080/15434303.2016.1256406
     https://doi.org/10.1080/15434303.2016.1256406 [Google Scholar]
  57. Timpe-Laughlin, V., & Dombi, J.
    (2020) Exploring L2 learners’ request behavior in a multi-turn conversation with a fully automated agent. Intercultural Pragmatics, 17(2), 221–257. 10.1515/ip‑2020‑0010
     https://doi.org/10.1515/ip-2020-0010 [Google Scholar]
  58. Trinity College
    Trinity College (2021) Our qualifications: English language. https://www.trinitycollege.com/qualifications/english-language
     [Google Scholar]
  59. UCLES
    UCLES (2011) Assessing speaking performance — level C1. https://www.cambridgeenglish.org/images/168620-assessing-speaking-performance-at-level-c1.pdf
     [Google Scholar]
  60. UCLES
    UCLES (2021) Cambridge English qualifications. https://www.cambridgeenglish.org/exams-and-tests/qualifications/general/
     [Google Scholar]
  61. Walters, F. S.
    (2007) A conversation-analytic hermeneutic rating protocol to assess L2 oral pragmatic competence. Language Testing, 27(2), 155–183. 10.1177/0265532207076362
     https://doi.org/10.1177/0265532207076362 [Google Scholar]
  62. (2009) A Conversation Analysis-informed test of L2 aural pragmatic comprehension. TESOL Quarterly, 43(1), 29–54. 10.1002/j.1545‑7249.2009.tb00226.x
     https://doi.org/10.1002/j.1545-7249.2009.tb00226.x [Google Scholar]
  63. Yamashita, S. O.
    (1996) Six measures of JSL pragmatics (Technical Report #14). University of Hawai’i, Second Language Teaching and Curriculum Center.
     [Google Scholar]
  64. Yoshitake, S.
    (1997) Interlanguage competence of Japanese students of English: A multi-test framework evaluation [Unpublished doctoral dissertation]. Columbia Pacific University.
  65. Youn, S. J.
    (2013) Validating task-based assessment of L2 pragmatics in interaction using mixed methods [Unpublished doctoral dissertation]. University of Hawai’i at Manoa.
  66. (2015) Validity argument for assessing L2 pragmatics in interaction using mixed methods. Language Testing, 32(2), 199–225. 10.1177/0265532214557113
     https://doi.org/10.1177/0265532214557113 [Google Scholar]
  67. Young, R. F.
    (2011) Interactional competence in language learning, teaching, and testing. InE. Hinkel (Ed.), Handbook of research in second language teaching and learning (Vol.21, pp.426–443). Routledge.
     [Google Scholar]
/content/journals/10.1075/ap.00022.roe
Loading
  • Article Type: Research Article
Keyword(s): conversation analysis; implicature; interactional competence; L2 assessment; routine formulae; speech acts; validity

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error