1887
image of Tracing relevance beyond codes and across modes
USD
Buy:$35.00 + Taxes

Abstract

Abstract

Drawing on Relevance Theory, the paper sketches out a framework that accounts for inference-making in creative multimodal texts, taking advocacy campaign posters as its case study. The analysis shows that in each poster semiotic resources are employed to create a micro-narrative exemplifying actors affected by a sociopolitical problem, whose function is to create assumptions against which a higher-order intention is recognized. The text-internal relevance within the micro-narrative is optimized by combining verbal and visual elements to communicate multimodal explicatures and implicatures. The visual elements are employed to invoke non-propositional effects that activate perceptual mechanisms to maximize emotional attachment with the issue advocated for. These non-propositional effects communicated by visual connotation carriers are essential, rather than extra, elements, contributing to the understanding of the propositional meaning communicated at the text-external level. The analysis shows that an inferential approach to multimodality is indispensable to account for (non)propositional content across different modes.

Loading

Article metrics loading...

/content/journals/10.1075/prag.23042.alt
2025-01-16
2025-02-15
Loading full text...

Full text loading...

References

  1. Ariel, Mira
    2010Defining Pragmatics. Cambridge: Cambridge University Press. 10.1017/CBO9780511777912
    https://doi.org/10.1017/CBO9780511777912 [Google Scholar]
  2. Arnheim, Rudolph
    1969Art and Visual Perception: A Psychology of the Creative Eye. Berkeley: University of California Press.
    [Google Scholar]
  3. Barthes, Roland
    1977Rhetoric of the Image. InImage, Music, Text, transl. byStephen Heath, –. London: Macmillan.
    [Google Scholar]
  4. Bateman, John
    2014Text and Image: A Critical Introduction to the Visual/Verbal Divide. New York: Routledge. 10.4324/9781315773971
    https://doi.org/10.4324/9781315773971 [Google Scholar]
  5. Chandler, Daniel
    2017Semiotics: The Basics. 3rd edition. New York: Routledge.
    [Google Scholar]
  6. Clark, Billy
    2013Relevance Theory. Cambridge: Cambridge University Press. 10.1017/CBO9781139034104
    https://doi.org/10.1017/CBO9781139034104 [Google Scholar]
  7. 2022Pragmatics the Basics. New York: Routledge.
    [Google Scholar]
  8. Cornevin, Vanessa, and Charles Forceville
    2017 “From Metaphor to Allegory: The Japanese Manga Afuganisu-tan.” Metaphor and the Social World (): –. 10.1075/msw.7.2.04cor
    https://doi.org/10.1075/msw.7.2.04cor [Google Scholar]
  9. Crisp, Peter
    2005 “Allegory and Symbol — A Fundamental Opposition?” Language and Literature: –. 10.1177/0963947005051287
    https://doi.org/10.1177/0963947005051287 [Google Scholar]
  10. Dicerto, Sara
    2018Multimodal Pragmatics and Translation: A New Model for Source Text Analysis. London: Palgrave Macmillan. 10.1007/978‑3‑319‑69344‑6
    https://doi.org/10.1007/978-3-319-69344-6 [Google Scholar]
  11. Falkum, Ingrid Lossius
    2019 “Metaphor and Metonymy in Acquisition: A Relevance- Theoretic Perspective.” InRelevance, Pragmatics and Interpretation: Essays in Honour of Deirdre Wilson, ed. byKate Scott, Billy Clark, and Robyn Carston, –. Cambridge: Cambridge University Press. 10.1017/9781108290593.018
    https://doi.org/10.1017/9781108290593.018 [Google Scholar]
  12. Fauconnier, Gilles, and Mark Turner
    2002The Way We Think: Conceptual Blending and the Mind’s Hidden Complexities. New York: Basic Books.
    [Google Scholar]
  13. Finnegan, A. Cara
    2001 “The Naturalistic Enthymeme and Visual Argument: Photographic Representation in the Skull Controversy.” Argumentation and Advocacy: –. 10.1080/00028533.2001.11951665
    https://doi.org/10.1080/00028533.2001.11951665 [Google Scholar]
  14. Forceville, Charles
    2020Visual and Multimodal Communication: Applying the Relevance Principle. New York: Oxford University Press. 10.1093/oso/9780190845230.001.0001
    https://doi.org/10.1093/oso/9780190845230.001.0001 [Google Scholar]
  15. Forceville, Charles, and Billy Clark
    2014 “Can Pictures Have Explicatures?” Linguagem em (Dis)curso: –. 10.1590/1982‑4017‑140301‑0114
    https://doi.org/10.1590/1982-4017-140301-0114 [Google Scholar]
  16. Garcés-Conejos Blitvich, Pilar
    2022 “Moral Emotions, Good Moral Panics, Social Regulation, and Online Public Shaming.” Language & Communication: –. 10.1016/j.langcom.2022.02.002
    https://doi.org/10.1016/j.langcom.2022.02.002 [Google Scholar]
  17. Grice, H. Paul
    1975 “Logic and Conversation.” InSyntax and Semantics (Vol. 3): Speech Acts, ed. byPeter Cole, and Jerry L. Morgan, –. New York: Academic Press. 10.1163/9789004368811_003
    https://doi.org/10.1163/9789004368811_003 [Google Scholar]
  18. Jewitt, Carey
    2013 “Multimodal Methods for Researching Digital Technologies.” InThe SAGE Handbook of Digital Technology Research, eds. bySara Price, Carey Jewitt, and Barry Brown, –. London: SAGE. 10.4135/9781446282229.n18
    https://doi.org/10.4135/9781446282229.n18 [Google Scholar]
  19. Kjeldsen, Jens
    2015 “Where Is Visual Argument?” InReflections on Theoretical Issues in Argumentation Theory, ed. byFrans H. van Eemeren, and Bart Garssen, –. Cham: Springer. 10.1007/978‑3‑319‑21103‑9_8
    https://doi.org/10.1007/978-3-319-21103-9_8 [Google Scholar]
  20. Kress, Gunther
    2010Multimodality: A Social Semiotic Approach to Contemporary Communication. Oxon: Routledge.
    [Google Scholar]
  21. Lakoff, George, and Mark Johnson
    1980Metaphors We Live By. Chicago: The University of Chicago Press.
    [Google Scholar]
  22. Leech, Geoffrey Neil
    1985 “Stylistics.” InDiscourse and Literature, ed. byTeun A. Van Dijk, –. John Benjamins. 10.1075/ct.3.04lee
    https://doi.org/10.1075/ct.3.04lee [Google Scholar]
  23. Lindblom, Kenneth
    2009 “Cooperative Principle.” InConcise Encyclopedia of Pragmatics, 2nd edition, ed. byMey Jacob, –. Oxford: Elsevier.
    [Google Scholar]
  24. Machin, David
    2016Introduction to Multimodal Analysis. London: Bloomsbury.
    [Google Scholar]
  25. Maillat, Didier
    2013 “Constraining Context Selection: On the Pragmatic Inevitability of Manipulation.” Journal of Pragmatics: –. 10.1016/j.pragma.2013.07.009
    https://doi.org/10.1016/j.pragma.2013.07.009 [Google Scholar]
  26. Markham, Annette, and Elizabeth Buchanan
    2012 “Ethical Decision-Making and Internet Research: Recommendations from the AoIR Ethics Working Committee (Version 2.0).” https://aoir.org/reports/ethics2.pdf
  27. Marlow, Mikaela
    2017 “Public Discourse and Intergroup Communication.” InOxford Research Encyclopedia of Communication, ed. byJon Nussbaum. Oxford: Oxford University Press. 10.1093/acrefore/9780190228613.013.420
    https://doi.org/10.1093/acrefore/9780190228613.013.420 [Google Scholar]
  28. Martinec, Radan, and Andrew Salway
    2005 “A System for Image-Text Relations in New (and Old) Media.” Visual Communication (): –. 10.1177/1470357205055928
    https://doi.org/10.1177/1470357205055928 [Google Scholar]
  29. McQuarrie, Edward F., and Barbara J. Phillips
    2005 “Indirect Persuasion in Advertising: How Consumers Process Metaphors Presented in Pictures and Words.” Journal of Advertising (): –. 10.1080/00913367.2005.10639188
    https://doi.org/10.1080/00913367.2005.10639188 [Google Scholar]
  30. Moeschler, Jacques
    2017 “Formal and Natural Languages: What Logic Tell Us About Natural Language.” InThe Routledge Handbook of Pragmatics, ed. byAnne Barron, Yueguo Gu, and Gerard Steen, –, Oxon: Routledge. 10.4324/9781315668925‑20
    https://doi.org/10.4324/9781315668925-20 [Google Scholar]
  31. O’Halloran, Kay L.
    2011 “Multimodal Discourse Analysis.” InThe Continuum Companion to Discourse Analysis, ed. byKen Hyland, and Brian Paltridge, –. London: Continuum.
    [Google Scholar]
  32. O’Halloran, Kay L., Sabine Tan, and Marissa K. L. E.
    2013 “Multimodal Pragmatics.” InPragmatics of Discourse, eds. byKlaus P. Schneider, and Anne Barron, –. Berlin: De Gruyter Mouton.
    [Google Scholar]
  33. Pilkington, Adrian
    2000Poetic Effects: A Relevance Theory Perspective. Amsterdam: John Benjamins. 10.1075/pbns.75
    https://doi.org/10.1075/pbns.75 [Google Scholar]
  34. Searle, John R.
    1979Expression and Meaning: Studies in the Theory of Speech Acts. Cambridge: Cambridge University Press. 10.1017/CBO9780511609213
    https://doi.org/10.1017/CBO9780511609213 [Google Scholar]
  35. Sperber, Dan and Deirdre Wilson
    1987 “Presumptions of Relevance.” Behavioral and Brain Sciences (): –. 10.1017/S0140525X00055618
    https://doi.org/10.1017/S0140525X00055618 [Google Scholar]
  36. Sperber, Dan, and Deirdre Wilson
    1995Relevance: Communication and Cognition. 2nd edition. Oxford: Blackwell.
    [Google Scholar]
  37. 2006 “Relevance Theory.” InThe Handbook of Pragmatics, ed. byLaurence R. Horn, and Gregory Ward, –. Oxford: Blackwell.
    [Google Scholar]
  38. 2008 “A Deflationary Account of Metaphors.” InThe Cambridge Handbook of Metaphor and Thought, ed. byRaymond W. Gibbs, –. Cambridge: Cambridge University Press. 10.1017/CBO9780511816802.007
    https://doi.org/10.1017/CBO9780511816802.007 [Google Scholar]
  39. Terkourafi, Marina
    2021 “Inference and Implicature.” InCambridge Handbook of Sociopragmatics, ed. byMichael Haugh, Daniel Kadar, and Marina Terkourafi, –. Cambridge: Cambridge University Press. 10.1017/9781108954105.004
    https://doi.org/10.1017/9781108954105.004 [Google Scholar]
  40. Unger, Christoph
    2019 “Allegory in Relation to Metaphor and Irony.” InRelevance, Pragmatics and Interpretation: Essays in Honour of Deirdre Wilson, ed. byKate Scott, Billy Clark, and Robyn Carston, –. Cambridge: Cambridge University Press. 10.1017/9781108290593.021
    https://doi.org/10.1017/9781108290593.021 [Google Scholar]
  41. Wilson, Deirdre
    2013 “Irony Comprehension: A Developmental Perspective.” Journal of Pragmatics: –. 10.1016/j.pragma.2012.09.016
    https://doi.org/10.1016/j.pragma.2012.09.016 [Google Scholar]
  42. 2016 “Relevance Theory.” InThe Oxford Handbook of Pragmatics, ed. byYang Huang, –. Oxford: Oxford University Press.
    [Google Scholar]
  43. 2017 “Irony, Hyperbole, Jokes and Banter”. InFormal Models in the Study of Language: Applications in Interdisciplinary Contexts, ed. byJoanna Blochowiak, Cristina Grisot, Stephanie Durrleman, and Christopher Laenzlinger, –. Cham: Springer International Publishing. 10.1007/978‑3‑319‑48832‑5_11
    https://doi.org/10.1007/978-3-319-48832-5_11 [Google Scholar]
  44. 2018 “Relevance Theory and Literary Interpretation.” InReading Beyond the Code: Literature and Relevance Theory, ed. byTerence Cave, and Deirdre Wilson, –. Oxford: Oxford University Press.
    [Google Scholar]
  45. 2022 “Communication, Comprehension and Interpretation”. InDynamism in Metaphor and Beyond (Festschrift for Ray Gibbs), ed. byHerbert Colston, Teenie Matlock, and Gerard Steen, –. Amsterdam: John Benjamins. 10.1075/milcc.9.08wil
    https://doi.org/10.1075/milcc.9.08wil [Google Scholar]
  46. Wilson, Deirdre, and Dan Sperber
    2007 “On Verbal Irony.” InIrony in Language and Thought: A Cognitive Science Reader, ed. byRaymond Gobbs Jr., and Herbert Colston, –. New York: Taylor and Francis.
    [Google Scholar]
  47. 2012 “A Deflationary Account of Metaphor.” InMeaning and Relevance, ed. byDeirdre Wilson, and Dan Sperber, –. Cambridge: Cambridge University Press. 10.1017/CBO9781139028370
    https://doi.org/10.1017/CBO9781139028370 [Google Scholar]
  48. Wilson, Deirdre, and Robyn Carston
    2019 “Pragmatics and the Challenge of ‘Non-Propositional’ Effects.” Journal of Pragmatics: –. 10.1016/j.pragma.2019.01.005
    https://doi.org/10.1016/j.pragma.2019.01.005 [Google Scholar]
/content/journals/10.1075/prag.23042.alt
Loading
/content/journals/10.1075/prag.23042.alt
Loading

Data & Media loading...

This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error