A parsimonious language model of social media credibility across disparate events

Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW

Volumn , Issue , 2017, Pages 126-145

  Mitra, Tanushree ^a   Wright, Graham P ^a   Gilbert, Eric ^a  

^a Georgia Institute of Technology   (United States)

Author keywords

Credibility; Events; Evidentiality; Language; Linguistic markers; Misinformation; Rumor; Social media; Twitter

Indexed keywords

BEHAVIORAL RESEARCH; COMPUTER SUPPORTED COOPERATIVE WORK; GROUPWARE; INTERACTIVE COMPUTER SYSTEMS; LINGUISTICS;

CREDIBILITY; EVENTS; EVIDENTIALITY; LANGUAGE; MISINFORMATION; RUMOR; SOCIAL MEDIA; TWITTER;

SOCIAL NETWORKING (ONLINE);

EID: 85014769852     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2998181.2998351     Document Type: Conference Paper

References (85)

1. Ahmer Arif, Kelley Shanahan, Fang-Ju Chou, Yoanna Dosouto, Kate Starbird, and Emma S Spiro. 2016. How Information Snowballs: Exploring the Role of Exposure in Online Rumor Propagation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 466-477.
2. Ann Banfield. 1982. Unspeakable sentences. (1982).
3. Sabine Bergler, Monia Doandes, Christine Gerard, and René Witte. 2004. Attributions. Exploring Attitude and Affect in Text: Theories and Applications, Technical Report SS-04-07(2004), 16-19.
4. Prashant Bordia and Nicholas DiFonzo. 2004. Problem solving in social interactions on the Internet: Rumor as social cognition. Social Psychology Quarterly 67, 1(2004), 33-49.
5. Prashant Bordia and Ralph L Rosnow. 1998. Rumor Rest Stops on the Information Highway Transmission Patterns in a Computer-Mediated Rumor Chain. Human Communication Research 25, 2(1998), 163-179.
6. Moira Burke, Lada Adamic, and Karyn Marciniak. 2013. Families on Facebook. In Seventh International AAAI Conference on Weblogs and Social Media.
7. Joan Bybee, Revere Perkins, and William Pagliuca. 1994. The evolution of grammar: Tense, aspect, and modality in the languages of the world. University of Chicago Press.
8. Carlos Castillo, Marcelo Mendoza, and Barbara Poblete. 2011. Information credibility on twitter. In Proceedings of the 20th international conference on World wide web. ACM, 675-684.
9. Steven H Chaffee. 1982. Mass media and interpersonal channels: Competitive, convergent, or complementary. Inter/media: Interpersonal communication in a media world (1982), 57-77.
10. Jacob Cohen. 1968. Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit. Psychological bulletin 70, 4(1968), 213.
11. M Corcoran. 2009. Death by cliff plunge, with a push from twitter. The New York Times (2009).
12. Riley Crane and Didier Sornette. 2008. Robust dynamic classes revealed by measuring the response function of a social system. Proceedings of the National Academy of Sciences 105, 41(2008), 15649-15653.
13. M de Marneffe, Christopher D Manning, and Christopher Potts. 2011. Veridicality and utterance understanding. In Semantic Computing (ICSC), 2011 Fifth IEEE International Conference on. IEEE, 430-437.
14. Marie-Catherine de Marneffe, Christopher D Manning, and Christopher Potts. 2012. Did it happen? The pragmatic complexity of veridicality assessment. Computational linguistics 38, 2(2012), 301-333.
15. Jaap J Dijkstra, Wim BG Liebrand, and Ellen Timminga. 1998. Persuasiveness of expert systems. Behaviour & Information Technology 17, 3(1998), 155-163.
16. Jacob Eisenstein, Noah A Smith, and Eric P Xing. 2011. Discovering sociolinguistic associations with structured sparsity. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1. ACL, 1365-1374.
17. Golnaz Esfandiari. 2010. The Twitter Devolution. Foreign Policy 7(2010), 2010.
18. Andrew J Flanagin and Miriam J Metzger. 2008. Digital media and youth: Unparalleled opportunity and unprecedented responsibility. Digital media, youth, and credibility (2008), 5-27.
19. BJ Fogg, Cathy Soohoo, David R Danielson, Leslie Marable, Julianne Stanford, and Ellen R Tauber. 2003. How do users evaluate the credibility of Web sites?: a study with over 2, 500 participants. In Proceedings of the 2003 conference on Designing for user experiences. ACM, 1-15.
20. BJ Fogg and Hsiang Tseng. 1999. The elements of computer credibility. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 80-87.
21. Jerome Friedman, Trevor Hastie, and Rob Tibshirani. 2010. Regularization paths for generalized linear models via coordinate descent. Journal of statistical software 33, 1(2010), 1.
22. Adrien Friggeri, Lada Adamic, Dean Eckles, and Justin Cheng. 2014. Rumor Cascades. In Eighth International AAAI Conference on Weblogs and Social Media.
23. Eric Gilbert. 2012. Phrases that signal workplace hierarchy. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 1037-1046.
24. Jeffrey Gottfried and Elisa Shearer. 2016. News Use Across Social Media Platforms 2016. Pew Research (2016). Retrieved Oct. 16, 2016 from www.journalism.org/2016/05/26/news-use-across-social-media-platforms-2016.
25. R Grover. 2011. Ad. ly: The Art of Advertising on Twitter. Businessweek, January 6 (2011).
26. Aditi Gupta and Ponnurangam Kumaraguru. 2012. Credibility ranking of tweets during high impact events. In Proceedings of the 1st Workshop on Privacy and Security in Online Social Media. ACM, 2.
27. Aditi Gupta, Ponnurangam Kumaraguru, Carlos Castillo, and Patrick Meier. 2014. Tweetcred: Real-time credibility assessment of content on twitter. In International Conference on Social Informatics. Springer, 228-243.
28. Aditi Gupta, Hemank Lamba, and Ponnurangam Kumaraguru. 2013. $1.00 per rt# bostonmarathon# prayforboston: Analyzing fake content on twitter. In eCrime Researchers Summit, 2013. IEEE, 1-12.
29. Jeffrey T Hancock, Lauren E Curry, Saurabh Goorha, and Michael Woodworth. 2007. On lying and being lied to: A linguistic analysis of deception in computer-mediated communication. Discourse Processes 45, 1(2007), 1-23.
30. Brian Hilligoss and Soo Young Rieh. 2008. Developing a unifying framework of credibility assessment: Construct, heuristics, and interaction in context. Information Processing & Management 44, 4(2008), 1467-1484.
31. Carl I Hovland, Irving L Janis, and Harold H Kelley. 1953. Communication and persuasion; psychological studies of opinion change. (1953).
32. Ken Hyland. 1998. Hedging in scientific research articles. Vol. 54. John Benjamins Publishing.
33. Ken Hyland. 2002. Authority and invisibility: Authorial identity in academic writing. Journal of pragmatics 34, 8(2002), 1091-1112.
34. Ken Hyland. 2005. Metadiscourse: Exploring interaction in writing. Wiley Online Library.
35. C Kanalley. 2011. Facebook Shutting Down Rumor Goes Viral: Site Said to be Ending March 15, 2011. The Huffington Post (2011).
36. Lauri Karttunen and Annie Zaenen. 2005. Veridicity. In Dagstuhl Seminar Proceedings. Schloss Dagstuhl-Leibniz-Zentrum für Informatik.
37. Paul-Kiparsky Kiparsky. 1971. Carol (1970), "Fact". Bierwisch, Manfred-Heidolph, Karl Erich (a cura di), Progress in Linguistics (A Collection of Papers), The Hague, Mouton (1971), 143-173.
38. Sejeong Kwon, Meeyoung Cha, Kyomin Jung, Wei Chen, and Yajun Wang. 2013. Prominent features of rumor propagation in online social media. In 2013 IEEE 13th International Conference on Data Mining. IEEE, 1103-1108.
39. George Lakoff. 1975. Hedges: a study in meaning criteria and the logic of fuzzy concepts. In contemporary Research in Philosophical Logic and Linguistic semantics. Springer, 221-271.
40. Qinying Liao and Lei Shi. 2013. She gets a sports car from our donation: rumor transmission in a chinese microblogging community. In Proc. CSCW.
41. Fang Liu, Andrew Burton-Jones, and Dongming Xu. 2014. Rumor on Social Media in Disasters: Extending Transmission to Retransmission. In Proceedings of the Pacific Asia Conference on Information Systems.
42. Jim Maddock, Kate Starbird, Haneen Al-Hassani, Daniel E Sandoval, Mania Orand, and Robert M Mason. 2015. Characterizing Online Rumoring Behavior Using Multi-Dimensional Signatures. (2015).
43. Oded Maimon and Lior Rokach. 2005. Data mining and knowledge discovery handbook. Vol. 2. Springer.
44. Marcelo Mendoza, Barbara Poblete, and Carlos Castillo. 2010. Twitter Under Crisis: Can we trust what we RT?. In Proceedings of the first workshop on social media analytics. ACM, 71-79.
45. Miriam J Metzger, Andrew J Flanagin, Keren Eyal, Daisy R Lemus, and Robert M McCann. 2003. Credibility for the 21st century: Integrating perspectives on source, message, and media credibility in the contemporary media environment. Annals of the International Communication Association 27, 1(2003), 293-335.
46. Terence F Mitchell and Shāhir ?asan. 1994. Modality, Mood, and Aspect in Spoken Arabic: With Special Reference to Egypt and the Levant. Vol. 11. Routledge.
47. Tanushree Mitra and Eric Gilbert. 2015. CREDBANK: A Large-Scale Social Media Corpus with Associated Credibility Annotations. In Ninth International AAAI Conference on Web and Social Media.
48. Tanushree Mitra, Clayton J Hutto, and Eric Gilbert. 2015. Comparing Person- and Process-centric Strategies for Obtaining Quality Data on Amazon Mechanical Turk. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 1345-1354.
49. Meredith Ringel Morris, Scott Counts, Asta Roseway, Aaron Hoff, and Julia Schwarz. 2012. Tweeting is believing?: understanding microblog credibility perceptions. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 441-450.
50. Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich. 2010. What do people ask their social networks, and why?: a survey study of status message q&a behavior. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 1739-1748.
51. Eni Mustafaraj and P Takis Metaxas. 2010. From obscurity to prominence in minutes: Political speech and real-time search. Web Science (2010).
52. Matthew L Newman, James W Pennebaker, Diane S Berry, and Jane M Richards. 2003. Lying words: Predicting deception from linguistic styles. Personality and social psychology bulletin 29, 5(2003), 665-675.
53. Brendan O'Connor, Michel Krieger, and David Ahn. 2010. TweetMotif: Exploratory Search and Topic Summarization for Twitter.. In Fourth International AAAI Conference on Weblogs and Social Media.
54. James Pustejovsky, Patrick Hanks, Roser Sauri, Andrew See, Robert Gaizauskas, Andrea Setzer, Dragomir Radev, Beth Sundheim, David Day, Lisa Ferro, and others. 2003. The timebank corpus. In Corpus linguistics, Vol. 2003.
55. Vahed Qazvinian, Emily Rosengren, Dragomir R Radev, and Qiaozhu Mei. 2011. Rumor has it: Identifying misinformation in microblogs. In Proceedings of the Conference on Empirical Methods in Natural Language Processing. ACL, 1589-1599.
56. Jacob Ratkiewicz, Michael Conover, Mark Meiss, Bruno Gonçalves, Snehal Patil, Alessandro Flammini, and Filippo Menczer. 2011. Truthy: mapping the spread of astroturf in microblog streams. In Proceedings of the 20th international conference companion on World wide web. ACM, 249-252.
57. Soo Young Rieh and David R Danielson. 2007. Credibility: A multidisciplinary framework. Annual review of information science and technology 41, 1(2007), 307-364.
58. Ralph L Rosnow. 1988. Rumor as communication: A contextualist approach. Journal of Communication 38, 1(1988), 12-28.
59. Ralph L Rosnow. 1991. Inside rumor: A personal journey. American Psychologist 46, 5(1991), 484.
60. Victoria L Rubin, Elizabeth D Liddy, and Noriko Kando. 2006. Certainty identification in texts: Categorization model and manual tagging results. In Computing attitude and affect in text: Theory and applications. Springer, 61-76.
61. Nadine B Sarter and David D Woods. 1991. Situation awareness: A critical but ill-defined phenomenon. The International Journal of Aviation Psychology 1, 1(1991), 45-57.
62. Roser Sauri. 2008. A Factuality Profiler for Eventualities in Text. Ph. D. Dissertation. Waltham, MA, USA. Advisor (s) Pustejovsky, James.
63. Roser Saurí and James Pustejovsky. 2009. FactBank: A corpus annotated with event factuality. Language resources and evaluation 43, 3(2009), 227-268.
64. Roser Saurí and James Pustejovsky. 2012. Are you sure that this happened? assessing the factuality degree of events in text. Computational Linguistics 38, 2(2012), 261-299.
65. Linda Schamber. 1991. Users' Criteria for Evaluation in a Multimedia Environment.. In Proceedings of the ASIS Annual Meeting, Vol. 28. ERIC, 126-33.
66. Charles C Self. 1996. Credibility. An integrated approach to communication theory and research 1(1996), 421-441.
67. Tamotsu Shibutani. 1966. Improvised news: A sociological study of rumor. Ardent Media.
68. Sandeep Soni, Tanushree Mitra, Eric Gilbert, and Jacob Eisenstein. 2014. Modeling factuality judgments in social media text. In Proc. ACL (short papers).
69. Kate Starbird, Emma Spiro, Isabelle Edwards, Kaitlyn Zhou, Jim Maddock, and Sindhuja Narasimhan. 2016. Could This Be True?: I Think So! Expressed Uncertainty in Online Rumoring. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 360-371.
70. D Sullivan. 2009. Twitter's Real Time Spam Problem. Search Engine Land (2009).
71. S Shyam Sundar. 2008. The MAIN model: A heuristic approach to understanding technology effects on credibility. Digital media, youth, and credibility 73100 (2008).
72. S Shyam Sundar and Clifford Nass. 2000. Source orientation in human-computer interaction programmer, networker, or independent social actor. Communication research 27, 6(2000), 683-703.
73. Yla R Tausczik and James W Pennebaker. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology 29, 1(2010), 24-54.
74. Zeynep Tufekci. 2014. Big Questions for Social Media Big Data: Representativeness, Validity and Other Methodological Pitfalls. In Eighth International AAAI Conference on Weblogs and Social Media.
75. Amos Tversky and Daniel Kahneman. 1975. Judgment under uncertainty: Heuristics and biases. In Utility, probability, and human decision making. Springer, 141-162.
76. Joe H Ward Jr. 1963. Hierarchical grouping to optimize an objective function. Journal of the American statistical association 58, 301(1963), 236-244.
77. Janyce Wiebe, Rebecca Bruce, Matthew Bell, Melanie Martin, and Theresa Wilson. 2001. A corpus study of evaluative and speculative language. In Proceedings of the Second SIGdial Workshop on Discourse and Dialogue-Volume 16. ACL, 1-10.
78. Janyce Wiebe, Theresa Wilson, and Claire Cardie. 2005. Annotating expressions of opinions and emotions in language. Language resources and evaluation 39, 2-3(2005), 165-210.
79. Janyce M Wiebe. 1994. Tracking point of view in narrative. Computational Linguistics 20, 2(1994), 233-287.
80. Theresa Wilson, Janyce Wiebe, and Paul Hoffmann. 2005. Recognizing contextual polarity in phrase-level sentiment analysis. In Proceedings of the conference on human language technology and empirical methods in natural language processing. ACL, 347-354.
81. Jaewon Yang and Jure Leskovec. 2011. Patterns of temporal variation in online media. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 177-186.
82. Li Zeng, Kate Starbird, and Emma S Spiro. 2016. # Unconfirmed: Classifying Rumor Stance in Crisis-Related Social Media Messages. In Tenth International AAAI Conference on Web and Social Media.
83. Zhe Zhao and Qiaozhu Mei. 2013. Questions about questions: An empirical analysis of information needs on Twitter. In Proceedings of the 22nd international conference on World Wide Web. ACM, 1545-1556.
84. Zhe Zhao, Paul Resnick, and Qiaozhu Mei. 2015. Enquiring minds: Early detection of rumors in social media from enquiry posts. In Proceedings of the 24th International Conference on World Wide Web. ACM, 1395-1405.
85. Arkaitz Zubiaga and Heng Ji. 2014. Tweet, but verify: epistemic study of information verification on twitter. Social Network Analysis and Mining 4, 1(2014), 1-12.