1887
Volume 7, Issue 2
  • ISSN 2213-1272
  • E-ISSN: 2213-1280
USD
Buy:$35.00 + Taxes

Abstract

Abstract

This paper presents a study of the (now suspended) online discussion forum Incels.me and its users, or , a virtual community of isolated men without a sexual life, who see women as the cause of their problems and often use the forum for misogynistic hate speech and other forms of incitement. Involuntary celibates have attracted media attention and concern, after a killing spree in April 2018 in Toronto, Canada. The aim of this study is to shed light on the group dynamics of the incel community, by applying mixed-methods quantitative and qualitative approaches to analyze how the users of the forum create in-group identity and how they construct major out-groups, particularly women. We investigate the vernacular used by incels, apply automatic profiling techniques to determine who they are, discuss the hate speech posted in the forum, and propose a Deep Learning system that is able to detect instances of misogyny, homophobia, and racism, with approximately 95% accuracy.

Loading

Article metrics loading...

/content/journals/10.1075/jlac.00026.jak
2019-07-08
2024-12-07
Loading full text...

Full text loading...

References

  1. Argamon, Shlomo, Moshe Koppel, James W. Pennebaker, and Jonathan Schler
    2009 “Automatically Profiling the Author of an Anonymous Text.” Communications of the ACM52(2):119–23. doi:  10.1145/1461928.1461959
    https://doi.org/10.1145/1461928.1461959 [Google Scholar]
  2. Berger, J. M.
    2017 “Extremist Construction of Identity: How Escalating Demands for Legitimacy Shape and Define In-Group and Out-Group Dynamics.” ICCT Research Paper. https://icct.nl/wp-content/uploads/2017/04/ICCT-Berger-Extremist-Construction-of-Identity-April-2017-2.pdf. 10.19165/2017.1.07
    https://doi.org/10.19165/2017.1.07 [Google Scholar]
  3. Blommaert, Jan
    2017 “Online-offline Modes of Identity and Community: Elliot Rodger’s Twisted World of Masculine Victimhood.” Tilburg Papers in Culture Studies200. https://biblio.ugent.be/publication/8551305/file/8551306.pdf
    [Google Scholar]
  4. Bou-Franch, Patricia, and Pilar Garcés-Conejos Blitvich
    2016 “Gender Ideology and Social Identity Processes in Online Language Aggression against Women.” InExploring Language Aggression against Women, edited byPatricia Bou-Franch, 59–81. Amsterdam/Philadelphia: John Benjamins. 10.1075/bct.86.03bou
    https://doi.org/10.1075/bct.86.03bou [Google Scholar]
  5. Brennan, Michael, Zadia Afroz, and Rachel Greenstadt
    2012 “Adversarial Stylometry: Circumventing Authorship Recognition to Preserve Privacy and Anonymity.” ACM Transactions on Information and System Security15(3): Art. 12. doi:  10.1145/2382448.2382450
    https://doi.org/10.1145/2382448.2382450 [Google Scholar]
  6. Brown, Alexander
    2017 “What is Hate Speech? Part 1: The Myth of Hate.” Law and Philosophy36: 419–468. doi:  10.1007/s10982‑017‑9297‑1
    https://doi.org/10.1007/s10982-017-9297-1 [Google Scholar]
  7. Brown, Rachel
    2016Defusing Hate: A Strategic Communication Guide to Counteract Dangerous Speech. https://www.ushmm.org/m/pdfs/20160229-Defusing-Hate-Guide.pdf
    [Google Scholar]
  8. Brown, Rupert, and Hanna Zagefka
    2005 “Ingroup Affiliations and Prejudice.” InOn the Nature of Prejudice, edited byJohn F. Dovidio, Peter Glick, and Laurie A. Rudman, 54–70. Maldon, MA, etc.: Blackwell. 10.1002/9780470773963.ch4
    https://doi.org/10.1002/9780470773963.ch4 [Google Scholar]
  9. Chollet, François
    2015Keras: Deep Learning Library for Theano and Tensorflow. https://keras.io
    [Google Scholar]
  10. Colleoni, Elanor, Alessandro Rozza, and Adam Arvidsson
    2014 “Echo Chamber or Public Sphere? Predicting Political Orientation and Measuring Political Homophily in Twitter Using Big Data.” Journal of Communication64(2):317–32. doi:  10.1111/jcom.12084
    https://doi.org/10.1111/jcom.12084 [Google Scholar]
  11. Collins, Michael
    2002 “Discriminative training methods for hidden markov models: Theory and experiments with perceptron algorithms.” Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing10: 1–8. doi:  10.3115/1118693.1118694
    https://doi.org/10.3115/1118693.1118694 [Google Scholar]
  12. De Smedt, Tom, and Walter Daelemans
    2012 “Pattern for Python.” Journal of Machine Learning Research13: 2063–2067. www.jmlr.org/papers/volume13/desmedt12a/desmedt12a.pdf
    [Google Scholar]
  13. De Smedt, Tom, Guy De Pauw, and Pieter Van Ostaeyen
    2018 “Automatic Detection of Online Jihadist Hate Speech.” CLiPS Technical Report Series7: 1–30. https://www.uantwerpen.be/images/uantwerpen/container2712/files/hate-speech-detection.pdf
    [Google Scholar]
  14. Dholakia, Utpal M., and Richard P. Bagozzi
    2004 “Motivational Antecedents, Constituents and Consequents of Virtual Community Identity.” InVirtual and Collaborative Teams: Process, Technologies, and Practice, edited bySusan H. Godar and Sharmila P. Ferris, 252–67. Hershey/London: Idea Group Publishing. doi:  10.4018/978‑1‑59140‑204‑6.ch014
    https://doi.org/10.4018/978-1-59140-204-6.ch014 [Google Scholar]
  15. DiMauro, Dina
    2008 “Reluctant Virginity: The Relationship between Sexual Status and Self-esteem.” Theses and Dissertations717. rdw.rowan.edu/etd/717
    [Google Scholar]
  16. Donnelly, Denise, Elisabeth Burgess, Sally Anderson, Regina Davis, and Joy Dillard
    2001 “Involuntary Celibacy: A Life Course Analysis.” The Journal of Sex Research38(2):159–69. doi:  10.1080/00224490109552083
    https://doi.org/10.1080/00224490109552083 [Google Scholar]
  17. Douglas, Karen M.
    2009 “Psychology, Discrimination and Hate Groups Online.” InThe Oxford Handbook of Internet Psychology, edited byAdam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, 155–63. Oxford/New York: Oxford University Press.
    [Google Scholar]
  18. Gilmore, David D.
    2001Misogyny: The Male Malady. Philadelphia: University of Pennsylvania Press. 10.9783/9780812200324
    https://doi.org/10.9783/9780812200324 [Google Scholar]
  19. Ging, Debbie
    2017 “Alphas, Betas, and Incels: Theorizing the Masculinities of the Manosphere.” Men and Masculinities. doi:  10.1177/1097184X17706401
    https://doi.org/10.1177/1097184X17706401 [Google Scholar]
  20. Haines, Russel, Jill Hough, Lan Cao, and Douglas Haines
    2014 “Anonymity in Computer-mediated Communication: More Contrarian Ideas with Less Influence.” Group Decision and Negotiation23(4):765–86. doi:  10.1007/s10726‑012‑9318‑2
    https://doi.org/10.1007/s10726-012-9318-2 [Google Scholar]
  21. Hamm, Mark S., and Ramón F. J. Spaij
    2017The Age of Lone Wolf Terrorism. New York/Chichester: Columbia University Press. 10.7312/hamm18174
    https://doi.org/10.7312/hamm18174 [Google Scholar]
  22. Haythornthwaite, Caroline
    2009 “Social Networks and Online Community.” InThe Oxford Handbook of Internet Psychology, edited byAdam N. Joinson, Katelyn Y. A. McKenna, Tom Postmes, and Ulf-Dietrich Reips, 121–137. Oxford/New York: Oxford University Press.
    [Google Scholar]
  23. Jane, Emma A.
    2014a “Back to the Kitchen, cunt”: Speaking the Unspeakable about Online Misogyny. Continuum: Journal of Media and Cultural Studies28(4):558–70. doi:  10.1080/10304312.2014.924479
    https://doi.org/10.1080/10304312.2014.924479 [Google Scholar]
  24. 2014b “‘You’re a Ugly, Whorish, Slut’. Understanding E-bile.” Feminist Media Studies14(4):431–46. doi:  10.1080/14680777.2012.741073
    https://doi.org/10.1080/14680777.2012.741073 [Google Scholar]
  25. 2017 “Systemic Misogyny Exposed: Translating Rapeglish from the Manosphere with a Random Rape Threat Generator.” International Journal of Cultural Studies21(6):661–80. doi:  10.1177/1367877917734042
    https://doi.org/10.1177/1367877917734042 [Google Scholar]
  26. Kämper, Andreas
    2011[r]echte Kerle. Zur Kumpanei der MännerRECHTSbewegung. Münster: UNRAST.
    [Google Scholar]
  27. Kim, Yoon
    2014 “Convolutional Neural Networks for Sentence Classification.” arXiv: 1408.5882, https://arxiv.org/pdf/1408.5882.pdf
  28. Kleinke, Sonja, and Birte Bös
    2015 “Intergroup Rudeness and the Metapragmatics of its Negotiation in Online Discussion Fora.” Pragmatics25(1):47–71. doi:  10.1075/prag.25.1.03kle
    https://doi.org/10.1075/prag.25.1.03kle [Google Scholar]
  29. Langman, Peter
  30. Larkin, Ralph W.
    2018 “Learning to be a Rampage Shooter: The Case of Elliot Rodger.” InThe Wiley Handbook on Violence in Education: Forms, Factors, and Preventions, edited byHarvey Shapiro, 69–84. Hoboken, NJ: Wiley & Sons. doi:  10.1002/9781118966709.ch4
    https://doi.org/10.1002/9781118966709.ch4 [Google Scholar]
  31. Liu, Bing
    2012Sentiment Analysis and Opinion Mining. San Rafael, CA: Morgan & Claypool. doi:  10.2200/S00416ED1V01Y201204HLT016
    https://doi.org/10.2200/S00416ED1V01Y201204HLT016 [Google Scholar]
  32. Mantilla, Karla
    2013 “Gendertrolling: Misogyny Adapts to New Media.” Feminist Studies39(2):563–70. https://www.jstor.org/stable/23719068
    [Google Scholar]
  33. ed. 2015Gendertrolling: How Misogyny Went Viral. Santa Barbara, CA: Praeger Press.
    [Google Scholar]
  34. Marx, Konstanze
    2018 “Cybermobbing aus sprachwissenschaftlicher Perspektive.” Sprachreport1/18: 1–9. https://ids-pub.bsz-bw.de/frontdoor/index/index/docId/7209
    [Google Scholar]
  35. Musolff, Andreas
    2012 “The Study of Metaphor as Part of Critical Discourse Analysis.” Critical Discourse Studies9(3):301–10. doi:  10.1080/17405904.2012.688300
    https://doi.org/10.1080/17405904.2012.688300 [Google Scholar]
  36. Newman, Matthew L., Carla J. Groom, Lori D. Handelman, and James W. Pennebaker
    2008 “Gender Differences in Language Use: An Analysis of 14,000 Text Samples.” Discourse Processes45: 211–36. doi:  10.1080/01638530802073712
    https://doi.org/10.1080/01638530802073712 [Google Scholar]
  37. Neuman, Yair, Dan Assaf, Yochai Cohen, and James L. Knoll
    2015 “Profiling School Shooters: Automatic Text-based Analysis.” Frontiers in Psychiatry6: Art. 86. doi:  10.3389/fpsyt.2015.00086
    https://doi.org/10.3389/fpsyt.2015.00086 [Google Scholar]
  38. Nockleby, John T.
    2000 “Hate Speech.” InEncyclopedia of the American Constitution. Vol.3, 2nd ed., edited byLeonard W. Levy and Kenneth L. Karst, 1277–1279. Detroit: Macmillan Reference US.
    [Google Scholar]
  39. Pennebaker, James W.
    2011The Secret Life of Pronouns. What our Words Say about us. New York: Bloomsbury.
    [Google Scholar]
  40. Pennebaker, James W., Martha E. Francis, and Roger J. Booth
    2001Linguistic Inquiry and Word Count: LIWC 2001. Mahwah, NJ: Lawrence Erlbaum Associates.
    [Google Scholar]
  41. Plummer, Ken
    2005 “Male Sexualities.” InHandbook of Studies on Men & Masculinities, edited byMichael S. Kimmel, Jeff Hearn, and R. W. Connell, 178–195. Thousand Oaks/London/New Delhi: Sage. 10.4135/9781452233833.n11
    https://doi.org/10.4135/9781452233833.n11 [Google Scholar]
  42. Rego, Richard
    2018 “Changing Forms and Platforms of Misogyny: Sexual Harassment of Women Journalists on Twitter.” Media Watch9(3):472–485. doi: 10.15655/mw/2018/v9i3/49480
    https://doi.org/10.15655/mw/2018/v9i3/49480 [Google Scholar]
  43. Salter, Anastasia, and Bridget Blodgett
    2012 “Hypermasculinity & Dickwolves: The Contentious Role of Women in the New Gaming Public.” Journal of Broadcasting & Electronic Media56(3):401–16. doi:  10.1080/08838151.2012.705199
    https://doi.org/10.1080/08838151.2012.705199 [Google Scholar]
  44. Schmidt, Anna, and Michael Wiegand
    2017 “A Survey on Hate Speech Detection Using Natural Language Processing.” Proceedings of the Fifth Workshop on Natural Language Processing for Social Media: 1–10. doi:  10.18653/v1/W17‑1101
    https://doi.org/10.18653/v1/W17-1101 [Google Scholar]
  45. Suler, John
    2004 “The Online Disinhibition Effect.” CyberPsychology & Behavior7(3):321–6. doi:  10.1089/1094931041291295
    https://doi.org/10.1089/1094931041291295 [Google Scholar]
  46. Turnage, Anna K.
    2007 “Email Flaming Behaviors and Organizational Conflict.” Computer-Mediated Communication13(1):43–59. doi:  10.1111/j.1083‑6101.2007.00385.x
    https://doi.org/10.1111/j.1083-6101.2007.00385.x [Google Scholar]
  47. Van Valkenburgh, Shawn P.
    2018 “Digesting the Red Pill: Masculinity and Neoliberalism in the Manosphere.” Men and Masculinities. doi:  10.1177/1097184X18816118
    https://doi.org/10.1177/1097184X18816118 [Google Scholar]
  48. Waltman, Michael, and John Haas
    2011The Communication of Hate. New York: Peter Lang. 10.3726/978‑1‑4539‑0046‑8
    https://doi.org/10.3726/978-1-4539-0046-8 [Google Scholar]
  49. Zimmerman, Shannon, Luisa Ryan, and David Duriesmith
    2018 “Recognizing the Violent Extremist Ideology of ‘Incels’.” Women in International Security policybrief09/2018: 1–5. www.academia.edu/37532571/Recognizing_the_Violent_Extremist_Ideology_of_Incels
    [Google Scholar]
/content/journals/10.1075/jlac.00026.jak
Loading
/content/journals/10.1075/jlac.00026.jak
Loading

Data & Media loading...

  • Article Type: Research Article
Keyword(s): forensic linguistics; hate speech; misogyny; social media; text analytics; text profiling
This is a required field
Please enter a valid email address
Approval was successful
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error