1887
  1. Home
  2. e-Journals
  3. Concentric
  4. Volume 48, Issue 1
  5. Article
Volume 48, Issue 1
  • ISSN 1810-7478
  • E-ISSN: 2589-5230
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This study takes a corpus pragmatics approach to investigate the use of evaluative language in professor reviews, focusing on how review writers express evaluation through recurrent four-word sequences and the pragmatic functions of these sequences in positive and negative reviews on the website, RateMyProfessors.com. Based on an analysis of a 2.9-million-word corpus of free text comments, the findings indicate that positive reviews used more 4-grams, and more varied types, than negative ones. The 4-word sequences were found to carry out four pragmatic functions: attitudinal evaluation, reader engagement, referential expression, and discourse organization. While a similar distribution of the main functional categories was observed among the top 100 4-grams in both review types, with evaluative clusters being most predominant, distinctive intra-genre variations were found in the ways review writers employed different functional sub-categories. For example, positive reviews relied heavily on hedged suggestion 4-grams to engage readers, whereas negative reviews used directive 4-grams for the same purpose. These findings suggest the important role of multi-word sequences in the understanding of evaluative resources in professor reviews of different valence types.

© Department of English, National Taiwan Normal University
Loading

Article metrics loading...

/content/journals/10.1075/consl.21010.ho
2022-05-02
2025-04-23

  • From This Site

    /content/journals/10.1075/consl.21010.ho
    dcterms_title,dcterms_subject,pub_keyword
    -contentType:Journal -contentType:Contributor -contentType:Concept -contentType:Institution
    10
    5
Loading full text...

Full text loading...

References

  1. Al-Ali, Mohammed Nahar
    2018 A genre-pragmatic analysis of Arabic academic book reviews (ArBRs). Pragmatics28.2:159–183. 10.1075/prag.17006.ala
     https://doi.org/10.1075/prag.17006.ala [Google Scholar]
  2. Bednarek, Monika
    2008 ‘An increasingly familiar tragedy’: Evaluative collocation and conflation. Functions of Language15.1:7–34. 10.1075/fol.15.1.03bed
     https://doi.org/10.1075/fol.15.1.03bed [Google Scholar]
  3. Biber, Douglas, Stig Johansson, Geoffrey Leech, Susan Conrad, and Edward Finegan
    (eds.) 1999 Longman of Grammar of Spoken and Written English. Essex, UK: Pearson Education.
     [Google Scholar]
  4. Biber, Douglas, Susan Conrad, and Viviana Cortes
    2004 If you look at…: Lexical bundles in university teaching and textbooks. Applied Linguistics25.3:371–405. 10.1093/applin/25.3.371
     https://doi.org/10.1093/applin/25.3.371 [Google Scholar]
  5. Biber, Douglas, and Federica Barbieri
    2007 Lexical bundles in university spoken and written registers. English for Specific Purposes26.3:263–286. 10.1016/j.esp.2006.08.003
     https://doi.org/10.1016/j.esp.2006.08.003 [Google Scholar]
  6. Blackwell, Sarah E.
    2010 Evaluation as a pragmatic act in Spanish film narratives. Journal of Pragmatics42.11:2945–2963. 10.1016/j.pragma.2010.06.018
     https://doi.org/10.1016/j.pragma.2010.06.018 [Google Scholar]
  7. Bychkovska, Tetyana, and Joseph J. Lee
    2017 At the same time: Lexical bundles in L1 and L2 university student argumentative writing. Journal of English for Academic Purposes30:38–52. 10.1016/j.jeap.2017.10.008
     https://doi.org/10.1016/j.jeap.2017.10.008 [Google Scholar]
  8. Cenni, Irene, and Patrick Goethals
    2017 Negative hotel reviews on TripAdvisor: A cross-linguistic analysis. Discourse, Context & Media16:22–30. 10.1016/j.dcm.2017.01.004
     https://doi.org/10.1016/j.dcm.2017.01.004 [Google Scholar]
  9. Clancy, Brian, and Anne O’Keeffe
    2015 Pragmatics. The Cambridge handbook of English corpus linguistics, ed. byDouglas Biber and Randi Reppen, 235–251. Cambridge, UK: Cambridge University Press. 10.1017/CBO9781139764377.014
     https://doi.org/10.1017/CBO9781139764377.014 [Google Scholar]
  10. Cortes, Viviana
    2004 Lexical bundles in published and student disciplinary writing: Examples from history and biology. English for Specific Purposes23.4:397–423. 10.1016/j.esp.2003.12.001
     https://doi.org/10.1016/j.esp.2003.12.001 [Google Scholar]
  11. Cortes, Viviana, and Jack A. Hardy
    2013 Analyzing the semantic prosody and semantic preference of lexical bundles. Critical and Corpus-based Approaches to Intercultural Rhetoric, ed. byDiane Belcher and Gayle Nelson, 180–201. University of Michigan Press.
     [Google Scholar]
  12. Cunningham, Kelly J., and Stephanie Link
    2021 Video and text feedback on ESL writing: Understanding attitude and negotiating relationships. Journal of Second Language Writing52:100797. 10.1016/j.jslw.2021.100797
     https://doi.org/10.1016/j.jslw.2021.100797 [Google Scholar]
  13. Dam-Jensen, Helle, and Karen Korning Zethsen
    2007 Pragmatic patterns and the lexical system – A reassessment of evaluation in language. Journal of Pragmatics39.9:1608–1623. 10.1016/j.pragma.2006.11.009
     https://doi.org/10.1016/j.pragma.2006.11.009 [Google Scholar]
  14. Fortanet, Inmaculada
    2008 Evaluative language in peer review referee reports. Journal of English for Academic Purposes7.1:27–37. 10.1016/j.jeap.2008.02.004
     https://doi.org/10.1016/j.jeap.2008.02.004 [Google Scholar]
  15. Grabowski, Łukasz
    2015 Keywords and lexical bundles within English pharmaceutical discourse: A corpus-driven description. English for Specific Purposes38:23–33. 10.1016/j.esp.2014.10.004
     https://doi.org/10.1016/j.esp.2014.10.004 [Google Scholar]
  16. Gray, Bethany, and Douglas Biber
    2013 Lexical frames in academic prose and conversation. International Journal of Corpus Linguistics18.1:109–136. 10.1075/ijcl.18.1.08gra
     https://doi.org/10.1075/ijcl.18.1.08gra [Google Scholar]
  17. Haugh, Michael
    2018 Corpus-based metapragmatics. Methods in Pragmatics, ed. byAndreas H. Jucker, Klaus P. Schneider and Wolfram Bublitz, 619–644. Boston: De Gruyter Mouton. 10.1515/9783110424928‑024
     https://doi.org/10.1515/9783110424928-024 [Google Scholar]
  18. Hewings, Martin
    2004 An ‘important contribution’ or ‘tiresome reading’? A study of evaluation in peer reviews of journal article submissions. Journal of Applied Linguistics1.3:247–274. 10.1558/japl.2004.1.3.247
     https://doi.org/10.1558/japl.2004.1.3.247 [Google Scholar]
  19. Hrežo, Vladislav
    2020 Exploring Phraseology in EU Legal Discourse. Language, Culture, Politics. International Journal1.5:29–52.
     [Google Scholar]
  20. Hunston, Susan
    2011 Corpus Approaches to Evaluation: Phraseology and Evaluative Language. New York: Routledge.
     [Google Scholar]
  21. Hyland, Ken
    2008 As can be seen: Lexical bundles and disciplinary variation. English for Specific Purposes27.1:4–21. 10.1016/j.esp.2007.06.001
     https://doi.org/10.1016/j.esp.2007.06.001 [Google Scholar]
  22. Hyland, Ken, and Polly Tse
    2009 ‘The leading journal in its field’: Evaluation in journal descriptions. Discourse Studies11.6:703–720. 10.1177/1461445609347234
     https://doi.org/10.1177/1461445609347234 [Google Scholar]
  23. Hyland, Ken
    2012 Bundles in academic discourse. Annual Review of Applied Linguistics32: 150–169. 10.1017/S0267190512000037
     https://doi.org/10.1017/S0267190512000037 [Google Scholar]
  24. Hyon, Sunny
    2011 Evaluation in tenure and promotion letters: Constructing faculty as communicators, stars, and workers. Applied Linguistics32.4:389–407. 10.1093/applin/amr003
     https://doi.org/10.1093/applin/amr003 [Google Scholar]
  25. Itakura, Hiroko
    2013 Hedging praise in English and Japanese book reviews. Journal of Pragmatics45.1:131–148. 10.1016/j.pragma.2012.11.003
     https://doi.org/10.1016/j.pragma.2012.11.003 [Google Scholar]
  26. Itakura, Hiroko, and Amy B. Tsui
    2011 Evaluation in academic discourse: Managing criticism in Japanese and English book reviews. Journal of Pragmatics43.5:1366–1379. 10.1016/j.pragma.2010.10.023
     https://doi.org/10.1016/j.pragma.2010.10.023 [Google Scholar]
  27. Liu, Chen-Yu, and Hao-Jan Howard Chen
    2020 Analyzing the functions of lexical bundles in undergraduate academic lectures for pedagogical use. English for Specific Purposes58:122–137. 10.1016/j.esp.2019.12.003
     https://doi.org/10.1016/j.esp.2019.12.003 [Google Scholar]
  28. Luzón, María José
    2012 “Your argument is wrong”: A contribution to the study of evaluation in academic weblogs. Text & Talk32.2:145–165. 10.1515/text‑2012‑0008
     https://doi.org/10.1515/text-2012-0008 [Google Scholar]
  29. Martin, James R., and Peter White
    (eds.) 2005 The Language of Evaluation: Appraisal in English. New York: Palgrave Macmillan. 10.1057/9780230511910
     https://doi.org/10.1057/9780230511910 [Google Scholar]
  30. Millar, Neil, and Susan Hunston
    2015 Adjectives, communities, and taxonomies of evaluative meaning. Functions of Language22.3:297–331. 10.1075/fol.22.3.01mil
     https://doi.org/10.1075/fol.22.3.01mil [Google Scholar]
  31. Moreno, Ana I., and Lorena Suárez
    2008 A study of critical attitude across English and Spanish academic book reviews. Journal of English for Academic Purposes7.1:15–26. 10.1016/j.jeap.2008.02.009
     https://doi.org/10.1016/j.jeap.2008.02.009 [Google Scholar]
  32. Pan, Fan, Randi Reppen, and Douglas Biber
    2016 Comparing patterns of L1 versus L2 English academic professionals: Lexical bundles in Telecommunications research journals. Journal of English for Academic Purposes21:60–71. 10.1016/j.jeap.2015.11.003
     https://doi.org/10.1016/j.jeap.2015.11.003 [Google Scholar]
  33. Pomerantz, Anita
    1986 Extreme case formulations: A way of legitimizing claims. Human Studies9.2:219–229. 10.1007/BF00148128
     https://doi.org/10.1007/BF00148128 [Google Scholar]
  34. Reber, Jeffrey S., Robert D. Ridge, and Samuel D. Downs
    2017 Perceptual and behavioral effects of expectations formed by exposure to positive or negative Ratemyprofessors.com evaluations. Cogent Psychology4.1:1–16. 10.1080/23311908.2017.1338324
     https://doi.org/10.1080/23311908.2017.1338324 [Google Scholar]
  35. Römer, Ute
    2005 “This seems somewhat counterintuitive, though…”: Negative evaluation in linguistic book reviews by male and female authors. Strategies in Academic Discourse, ed. byElena Tognini-Bonelli and Gabriella Del Lungo Camiciotti, 97–115. Philadelphia, PA: John Benjamins. 10.1075/scl.19.08rom
     https://doi.org/10.1075/scl.19.08rom [Google Scholar]
  36. 2008 Identification impossible?: A corpus approach to realizations of evaluative meaning in academic writing. Functions of Language15.1:115–130. 10.1075/fol.15.1.07rom
     https://doi.org/10.1075/fol.15.1.07rom [Google Scholar]
  37. Rühlemann, Christoph, and Karin Aijmer
    2015 Introduction. Corpus pragmatics: Laying the foundations. Corpus Pragmatics: A handbook, ed. byKarin Aijmer and Christoph Rühlemann, 1–26. Cambridge: Cambridge University Press. 10.1017/CBO9781139057493.001
     https://doi.org/10.1017/CBO9781139057493.001 [Google Scholar]
  38. Scherr, Sebastian, Philipp Müller, and Victoria Fast
    2013 Single comments or average ratings: Which elements of RateMyProfessors. com™ shape university students’ judgments and course choice intentions?Educational Assessment, Evaluation and Accountability25.2:131–141. 10.1007/s11092‑013‑9164‑z
     https://doi.org/10.1007/s11092-013-9164-z [Google Scholar]
  39. Scott, Mike
    2017 WordSmith Tools Version 7. Stroud: Lexical Analysis Software.
     [Google Scholar]
  40. Simpson-Vlach, Rita, and Nick C. Ellis
    2010 An academic formulas list: New methods in phraseology research. Applied Linguistics31.4:487–512. 10.1093/applin/amp058
     https://doi.org/10.1093/applin/amp058 [Google Scholar]
  41. Siyanova-Chanturia, Anna, and Taha Omidian
    2019 Key issues in researching multiword items. The Routledge Handbook of Vocabulary Studies, ed. byStuart Webb, 529–544. New York: Routledge. 10.4324/9780429291586‑33
     https://doi.org/10.4324/9780429291586-33 [Google Scholar]
  42. Skalicky, Stephen
    2013 Was this analysis helpful? A genre analysis of the Amazon.com discourse community and its “most helpful” product reviews. Discourse, Context & Media2.2:84–93. 10.1016/j.dcm.2013.04.001
     https://doi.org/10.1016/j.dcm.2013.04.001 [Google Scholar]
  43. Song, Chengfang
    2015 Lexical realization of attitudinal meaning and its coding in discourse analysis. Text & Talk35.3:383–405.
     [Google Scholar]
  44. Stubbs, Michael
    2001 Words and Phrases: Corpus Studies of Lexical Semantics. Oxford: Blackwell publishers.
     [Google Scholar]
  45. Su, Hang
    2016 How products are evaluated? Evaluation in customer review texts. Language Resources and Evaluation50.3:475–495. 10.1007/s10579‑015‑9323‑6
     https://doi.org/10.1007/s10579-015-9323-6 [Google Scholar]
  46. Su, Hang, and Susan Hunston
    2019 Language patterns and attitude revisited: Adjective patterns, attitude and appraisal. Functions of Language26.3:343–371. 10.1075/fol.16030.su
     https://doi.org/10.1075/fol.16030.su [Google Scholar]
  47. Subtirelu, Nicholas
    2018 Exploring the intersection of gender and race in evaluations of mathematics instructors on ratemyprofessors.com. Studies in Corpus-based Sociolinguistics, ed. byEric Friginal, 219–235. New York: Routledge.
     [Google Scholar]
  48. Taboada, Maite
    2011 Stages in an online review genre. Text & Talk31.2:247–269. 10.1515/text.2011.011
     https://doi.org/10.1515/text.2011.011 [Google Scholar]
  49. Taboada, Maite, Marta Carretero, and Jennifer Hinnell
    2014 Loving and hating the movies in English, German and Spanish. Languages in Contrast14.1:127–161. 10.1075/lic.14.1.07tab
     https://doi.org/10.1075/lic.14.1.07tab [Google Scholar]
  50. Taboada, Maite
    2016 Sentiment analysis: An overview from linguistics. Annual Review of Linguistics2:325–347. 10.1146/annurev‑linguistics‑011415‑040518
     https://doi.org/10.1146/annurev-linguistics-011415-040518 [Google Scholar]
  51. Thominet, Luke
    2016 10/10 would review again: Variation in the player game review genre. Technical Communication Quarterly25.3:167–177. 10.1080/10572252.2016.1185158
     https://doi.org/10.1080/10572252.2016.1185158 [Google Scholar]
  52. Thompson, Geoffrey, and Susan Hunston
    2000 Evaluation: An introduction. Evaluation in text: Authorial Stance and the Construction of Discourse, ed. bySusan Hunston and Geoffrey Thompson, 1–27. New York: Oxford University Press.
     [Google Scholar]
  53. Vásquez, Camilla
    2011 Complaints online: The case of TripAdvisor. Journal of Pragmatics43.6:1707–1717. 10.1016/j.pragma.2010.11.007
     https://doi.org/10.1016/j.pragma.2010.11.007 [Google Scholar]
  54. 2014 The Discourse of Online Consumer Reviews. New York: Bloomsbury Publishing.
     [Google Scholar]
  55. White, Peter
    2000 Dialogue and inter-subjectivity: Reinterpreting the semantics of modality and hedging. Dialogue Analysis VII: Working with Dialogue, ed. byMalcolm Coulthard, Janet Cotterill and Frances Rock, 67–80. Tubingen: Neimeyer. 10.1515/9783110941265‑006
     https://doi.org/10.1515/9783110941265-006 [Google Scholar]
  56. 2020 The Appraisal Website: 5. Engagement and Dialogic Positioning – An Outline of Engagement. RetrievedOctober 8, 2021, fromhttps://www.grammatics.com/appraisal/appraisalguide/unframed/stage5-engagement.htmhttps://www.grammatics.com/appraisal/index.html
     [Google Scholar]
  57. Wright, Heidi R.
    2019 Lexical bundles in stand-alone literature reviews: Sections, frequencies, and functions. English for Specific Purposes54:1–14. 10.1016/j.esp.2018.09.001
     https://doi.org/10.1016/j.esp.2018.09.001 [Google Scholar]
  58. Yin, Xiaoyi, and Shuangling Li
    2021 Lexical bundles as an intradisciplinary and interdisciplinary mark: A corpus-based study of research articles from business, biology, and applied linguistics. Applied Corpus Linguistics1.1:100006. 10.1016/j.acorp.2021.100006
     https://doi.org/10.1016/j.acorp.2021.100006 [Google Scholar]
/content/journals/10.1075/consl.21010.ho
Loading
A corpus-pragmatics approach to evaluation in professor reviews
Concentric 48, 114 (2022); https://doi.org/10.1075/consl.21010.ho
/content/journals/10.1075/consl.21010.ho
/content/journals/10.1075/consl.21010.ho
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): corpus pragmatics; evaluative language; multi-word sequences; online professor reviews; 常用詞串; 教師教學評價; 評價語言; 語料庫語用學

Most Cited

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error