The bag of communities: Identifying abusive behavior online with preexisting internet data

Conference on Human Factors in Computing Systems - Proceedings

Volumn 2017-May, Issue , 2017, Pages 3175-3187

  Chandrasekharan, Eshwar ^a   Samory, Mattia ^b   Srinivasan, Anirudh ^a   Gilbert, Eric ^a  

^a GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^b UNIVERSITY OF PADOVA   (Italy)

Author keywords

Abusive behavior; Machine learning; Moderation; Online communities; Social computing

Indexed keywords

HUMAN ENGINEERING; LEARNING SYSTEMS;

ABUSIVE BEHAVIOR; COMPUTATIONAL APPROACH; ENGINEERING RESOURCES; INTERNET COMMUNITIES; MODERATION; ON-LINE COMMUNITIES; RECENT RESEARCHES; SOCIAL COMPUTING;

SOCIAL NETWORKING (ONLINE);

EID: 85029490388     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/3025453.3026018     Document Type: Conference Paper

References (65)

1. Ricardo Baeza-Yates, Berthier Ribeiro-Neto, and others. 1999. Modern information retrieval. Vol. 463. ACM press New York.
2. Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman Vaughan. 2010. A theory of learning from different domains. Machine learning 79, 1-2 (2010), 151-175.
3. Michael S Bernstein, Andrés Monroy-Hernández, Drew Harry, Paul André, Katrina Panovich, and Gregory G Vargas. 2011. 4chan and/b: An Analysis of Anonymity and Ephemerality in a Large Online Community. In ICWSM. 50-57.
4. Sam Biddle. August, 5, 2015. Reddit (Finally) Bans CoonTown. http://gawker.com/reddit-finally-bans-coontown-1722332877, Gawker (August, 5, 2015).
5. Samuel Brody and Nicholas Diakopoulos. 2011. Cooooooooooooooollllllllllllll!!!!!!!!!!!!!!: using word lengthening to detect sentiment in microblogs. In Proceedings of the conference on empirical methods in natural language processing. Association for Computational Linguistics, 562-570.
6. Brooks Buffington. April 4, 2015. Personal communication. 2 (April 4, 2015).
7. Catherine Buni and Soraya Chemaly. 2016. The Secret Rules of the Internet, Apr. 2016. http://www.theverge.com/2016/4/13/11387934/internet-moderator-history-youtube-facebook-reddit-censorship-free-speech (2016).
8. Nan Cao, Conglei Shi, Sabrina Lin, Jie Lu, Yu-Ru Lin, and Ching-Yung Lin. 2016. TargetVue: Visual Analysis of Anomalous User Behaviors in Online Communication Systems. Visualization and Computer Graphics, IEEE Transactions on 22, 1 (2016), 280-289.
9. Stevie Chancellor, Zhiyuan Jerry Lin, and Munmun De Choudhury. 2016. This Post Will Just Get Taken Down: Characterizing Removed Pro-Eating Disorder Social Media Content. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 1157-1162.
10. Justin Cheng, Cristian Danescu-Niculescu-Mizil, and Jure Leskovec. 2015. Antisocial Behavior in Online Discussion Communities. In Ninth International AAAI Conference on Web and Social Media.
11. Cristian Danescu-Niculescu-Mizil, Moritz Sudhof, Dan Jurafsky, Jure Leskovec, and Christopher Potts. 2013. A computational approach to politeness with application to social factors. In Proc. ACL'13.
12. Hal Daumé III. 2009. Frustratingly easy domain adaptation. arXiv preprint arXiv:0907.1815 (2009).
13. Hal Daume III and Daniel Marcu. 2006. Domain adaptation for statistical classifiers. Journal of Artificial Intelligence Research (2006), 101-126.
14. Nicholas Diakopoulos. Apr. 2015a. Picking the NYT Picks: Editorial criteria and automation. (Apr. 2015).
15. Nicholas A Diakopoulos. 2015b. The Editor's Eye: Curation and Comment Relevance on the New York Times. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing. ACM, 1153-1157.
16. Karthik Dinakar, Roi Reichart, and Henry Lieberman. 2011. Modeling the detection of Textual Cyberbullying. In The Social Mobile Web. 11-17.
17. Roger Dingledine, Nick Mathewson, and Paul Syverson. 2004. Tor: The second-generation onion router. Technical Report. DTIC Document.
18. Bruce Drake. 2014. The darkest side of online harassment: Menacing behavior. Pew Research Center, http://www.pewresearch.org/fact-tank/2015/06/01/the-darkest-side-of-online-harassment-menacing-behavior/(2014).
19. Maeve Duggan. 2014. Online harassment: Summary of findings. Pew Research Center, http://www.pewinternet.org/2014/10/22/online-harassment/ (accessed 02 June 2015) (2014).
20. Randy Farmer and Bryce Glass. 2010. Building web reputation systems. "O'Reilly Media, Inc.". 243-276 pages.
21. Eric Gilbert. 2013. Widespread underprovision on reddit. In Proceedings of the 2013 conference on Computer supported cooperative work. ACM, 803-808.
22. Roberto González-Ibánez, Smaranda Muresan, and Nina Wacholder. 2011. Identifying sarcasm in Twitter: a closer look. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies: short papers-Volume 2. Association for Computational Linguistics, 581-586.
23. Clive WJ Granger. 1969. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society (1969), 424-438.
24. Jiawei Han, Micheline Kamber, and Jian Pei. 2011. Data mining: concepts and techniques. Elsevier.
25. Susan Herring, Kirk Job-Sluder, Rebecca Scheckler, and Sasha Barab. 2002. Searching for safety online: Managing "trolling" in a feminist forum. The Information Society 18, 5 (2002), 371-384.
26. Lauren Hockenson. July, 9, 2015. What is Voat, the site Reddit users are flocking to? http://thenextweb.com/insider/2015/07/09/what-is-voat-the-site-reddit-users-are-flocking-to/, (July, 9, 2015).
27. Ruogu Kang, Laura Dabbish, and Katherine Sutton. 2016. Strangers on Your Phone: Why People Use Anonymous Communication Applications. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 359-370.
28. Sara Kiesler, Robert Kraut, Paul Resnick, and Aniket Kittur. 2012. Regulating behavior in online communities. Building Successful Online Communities: Evidence-Based Social Design. MIT Press, Cambridge, MA (2012), 125-178.
29. Amy Jo Kim. 2000. Community building on the web: Secret strategies for successful online communities. Addison-Wesley Longman Publishing Co., Inc.
30. Cliff Lampe and Paul Resnick. 2004. Slash (dot) and burn: distributed moderation in a large online conversation space. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 543-550.
31. Lawrence Lessig. 1999. Code and other laws of cyberspace. Vol. 3. Basic books New York.
32. Jing-Kai Lou, Kuan-Ta Chen, and Chin-Laung Lei. 2009. A collusion-resistant automation scheme for social moderation systems. In Consumer Communications and Networking Conference, 2009. CCNC 2009. 6th IEEE. IEEE, 1-5.
33. Christopher D Manning, Prabhakar Raghavan, Hinrich Schütze, and others. 2008. Introduction to information retrieval. Vol. 1. Cambridge university press Cambridge.
34. Bamshad Mobasher, Robin Burke, Runa Bhaumik, and Chad Williams. 2007. Toward trustworthy recommender systems: An analysis of attack models and algorithm robustness. ACM Transactions on Internet Technology (TOIT) 7, 4 (2007), 23.
35. Justin Wm Moyer. July, 17, 2015. Coontown': A noxious, racist corner of Reddit survives recent purge. https://www.washingtonpost.com/news/morning-mix/wp/2015/07/17/coontown-a-noxious-racist-corner-of-reddit-survives-recent-purge/, The Washington Post (July, 17, 2015).
36. Lev Muchnik, Sinan Aral, and Sean J Taylor. 2013. Social influence bias: A randomized experiment. Science 341, 6146 (2013), 647-651.
37. Edward Newell, David Jurgens, Haji Mohammad Saleem, Hardik Vala, Jad Sassine, Caitrin Armstrong, and Derek Ruths. 2016. User Migration in Online Social Networks: A Case Study on Reddit During a Period of Community Unrest. In Tenth International AAAI Conference on Web and Social Media.
38. Mark EJ Newman. 2006. Modularity and community structure in networks. Proceedings of the national academy of sciences 103, 23 (2006), 8577-8582.
39. Fox News. Apr. 2009. 4Chan: The Rude, Raunchy Underbelly of the Internet. http://www.foxnews.com/story/2009/04/08/4chan-rude-raunchy-underbelly-internet.html. (Apr. 2009).
40. Elinor Ostrom. 2015. Governing the commons. Cambridge university press.
41. Ellen Pao. July 16, 2015. Former Reddit CEO Ellen Pao: The trolls are winning the battle for the Internet. http://wapo.st/1HJM82l, (July 16, 2015).
42. Deokgun Park, Simranjit Sachar, Nicholas Diakopoulos, and Niklas Elmqvist. 2016. Supporting comment moderators in identifying high quality online news comments. In Proc. Conference on Human Factors in Computing Systems (CHI).
43. Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, and others. 2011. Scikit-learn: Machine learning in Python. The Journal of Machine Learning Research 12 (2011), 2825-2830.
44. Jenny Preece and Diane Maloney-Krichmar. 2003. Online communities: focusing on sociability and usability. Handbook of human-computer interaction (2003), 596-620.
45. Reddit. 2014. Remember the human. https://www.reddit.com/r/blog/comments/1ytp7q/rememberthehuman/. (2014).
46. Reddit. 2015a. Reddiquette. https://www.reddit.com/wiki/reddiquette. (2015).
47. Reddit. 2015c. Subreddit rules. https://www.reddit.com/r/AskHistorians/wiki/rules. (2015).
48. Reddit. June, 10, 2015b. Removing harassing subreddits (self announcement). https://www.reddit.com/r/announcements/comments/39bpam/removingharassingsubreddits/, (June, 10, 2015).
49. Paul Resnick, Ko Kuwabara, Richard Zeckhauser, and Eric Friedman. 2000. Reputation systems. Commun. ACM 43, 12 (2000), 45-48.
50. Paul Resnick and Richard Zeckhauser. 2002. Trust among strangers in internet transactions: Empirical analysis of ebays reputation system. The Economics of the Internet and E-commerce 11, 2 (2002), 23-25.
51. Ellen Riloff, Ashequl Qadir, Prafulla Surve, Lalindra De Silva, Nathan Gilbert, and Ruihong Huang. 2013. Sarcasm as Contrast between a Positive Sentiment and Negative Situation. In EMNLP, Vol. 13. 704-714.
52. Adi Robertson. June, 10, 2015. Reddit bans 'Fat People Hat' and other subreddits under new harassment rules. http://www.theverge.com/2015/6/10/8761763/reddit-harassment-ban-fat-people-hate-subreddit, The Verge (June, 10, 2015).
53. P. Shuman. Jul 2007. Fox 11 investigates: anonymous. https://www.youtube.com/watch?v=DNO6G4ApJQY. (Jul 2007).
54. N. Shuyo. 2010. Language detection library for java. (2010).
55. Leiser Silva, Lakshmi Goel, and Elham Mousavidin. 2009. Exploring the dynamics of blog communities: the case of MetaFilter. Information Systems Journal 19, 1 (2009), 55-81.
56. Christine B Smith, Margaret L McLaughlin, and Kerry K Osborne. 1997. Conduct control on Usenet. Journal of Computer-Mediated Communication 2, 4 (1997), 0-0.
57. Sara Sood, Judd Antin, and Elizabeth Churchill. 2012a. Profanity use in online communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1481-1490.
58. Sara Owsley Sood, Judd Antin, and Elizabeth F Churchill. 2012b. Using Crowdsourcing to Improve Profanity Detection. In AAAI Spring Symposium: Wisdom of the Crowd.
59. Sara Owsley Sood, Elizabeth F Churchill, and Judd Antin. 2012c. Automatic identification of personal insults on social news sites. Journal of the American Society for Information Science and Technology 63, 2 (2012), 270-285.
60. R. Sorgatz. 2009. Macroanonymous is the new microfamous. http://fimoculous.com/archive/post-5738.cfm. (2009).
61. Abhay Sukumaran, Stephanie Vezich, Melanie McHugh, and Clifford Nass. 2011. Normative influences on thoughtful online participation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3401-3410.
62. Nabiha Syed and Ben Smith. Jun. 2015. A First Amendment For Social Platforms. https://medium.com/@BuzzFeed/a-first-amendment-for-social-platforms-202c0eab7054. (Jun. 2015).
63. Nitasha Tiku and Casey Newton. February 4, 2015. Twitter CEO:We suck at dealing with abuse. http://www.theverge.com/2015/2/4/7982099/twitter-ceo-sent-memo-taking-personal-responsibility-for-the, The Verge (February 4, 2015).
64. Ruth L Williams and Joseph Cothrel. 2000. Four smart ways to run online communities. MIT Sloan Management Review 41, 4 (2000), 81.
65. Jun-Ming Xu, Benjamin Burchfiel, Xiaojin Zhu, and Amy Bellmore. 2013. An Examination of Regret in Bullying Tweets. In HLT-NAACL. 697-702.