Using Text Mining to Compare Online Pro- and Anti-Vaccine Headlines: Word Usage, Sentiments, and Online Popularity

Communication Studies

Volumn 69, Issue 1, 2018, Pages 103-122

  Xu, Zhan ^a   Guo, Hao ^b  

^a UNIVERSITY OF CONNECTICUT   (United States)

^b DANA FARBER CANCER INSTITUTE   (United States)

Author keywords

Anti Vaccine; Misinformation; Sentiment Analysis; Text Mining; Vaccine

Indexed keywords

EID: 85038349677     PISSN: 10510974     EISSN: 17451035     Source Type: Journal    
DOI: 10.1080/10510974.2017.1414068     Document Type: Article

References (69)

1. Alhabash, S., McAlister, A. R., Hagerstrom, A., Quilliam, E. T., Rifon, N. J., & Richards, J. I. (2013). Between likes and shares: Effects of emotional appeal and virality on the persuasiveness of anticyberbullying messages on facebook. Cyberpsychology, Behavior, and Social Networking, 16(3), 175–182. doi:10.1089/cyber.2012.0265
2. Anderson, K., Dixon, P. W., Karr, L. M., & Yudko, E., (2004). Reaction times to words vs. symbols for both hands. Perceptual and Motor Skills, 99(3), 754–756. doi:10.2466/pms.99.3.754-756
3. Arora, N. K., Hesse, B. W., Rimer, B. K., Viswanath, K., Clayman, M. L., & Croyle, R. T., (2008). Frustrated and confused: The American public rates its cancer-related information-seeking experiences. Journal of General Internal Medicine, 23(3), 223–228. doi:10.1007/s11606-007-0406-y
4. Asur, S., & Huberman, B. A., (2010). Predicting the future with social media. 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, (1), 492–499.
5. Atwell, J. E., Van Otterloo, J., Zipprich, J., Winter, K., Harriman, K., Salmon, D. A., … Omer, S. B., (2013). Nonmedical vaccine exemptions and pertussis in California, 2010. Pediatrics, 132(4), 624–630. doi:10.1542/peds.2013-0878
6. Bean, S. J., (2011). Emerging and continuing trends in vaccine opposition website content. Vaccine, 29(10), 1874–1880. doi:10.1016/j.vaccine.2011.01.003
7. Bell, A., (1991). The Language of News Media. Oxford, England: Blackwell.
8. Bhattacharya, G., (2012). Self-management of type 2 diabetes among African Americans in the Arkansas Delta: A strengths perspective in social-cultural context. Journal of Health Care for the Poor and Underserved, 23(1), 161–178. doi:10.1353/hpu.2012.0035
9. Buller, D. B., Borland, R. L., & Burgoon, M., (1998). Impact of behavioral intention on effectiveness of message features: Evidence from the family sun safety project. Human Communication Research, 24(3), 433–453. doi:10.1111/hcre.1998.24.issue-3
10. Buller, D. B., Burgoon, M., Hall, J. R., Levine, N., Taylor, A. M., Beach, B. H., … Bergen, A., (2000). Using language intensity to increase the success of a family intervention to protect children from ultraviolet radiation: Predictions from language expectancy theory. Preventive Medicine, 30(2), 103–114. doi:10.1006/pmed.1999.0600
11. Burgoon, J. K., Blair, J. P., Qin, T., & Nunamaker, J. F., (2003). Detecting deception through linguistic analysis. In Chen, H., Miranda, R., Zeng, D. D., Demchek, C., Schroeder, J., Madhusudan, T., (Eds.), Intelligence and securityinformatics ISI 2003. Lecture Notes in Computer Science, (Vol. 2665, pp. 91–101). Berlin, Germany: Springer.
12. Burgoon, M., Jones, S. B., & Stewart, D., (1975). Toward a message‐centered theory of persuasion: Three empirical investigations of language intensity. Human Communication Research, 1(3), 240–256. doi:10.1111/hcre.1975.1.issue-3
13. Cacioppo, J. T., & Berntson, G. G., (1994). Relationship between attitudes and evaluative space: A critical review, with emphasis on the separability of positive and negative substrates. Psychological Bulletin, 115(3), 401–423. doi:10.1037/0033-2909.115.3.401
14. th ed.). W., Atkinson, S., Wolfe, & J., Hamborsky (Eds), Washington, DC: Public Health Foundation.
15. comScore. (2016). comScore releases February 2016 U.S. desktop search engine rankings. Retrieved from https://www.comscore.com/Insights/Rankings/comScore-Releases-February-2016-US-Desktop-Search-Engine-Rankings
16. Conrick, T., (2016). CDC “nose” that live attenuated influenza vaccine is dangerous. Retrieved from http://www.ageofautism.com/2016/10/cdc-nose-that-live-attenuate-influenza-vaccine-is-dangerous.html
17. Conroy, N. J., Rubin, V. L., & Chen, Y., (2015). Automatic deception detection: Methods for finding fake news. Proceedings of the Association for Information Science and Technology, 52(1), 1–4. doi:10.1002/pra2.2015.145052010082
18. Davies, P., Chapman, S., & Leask, J., (2002). Antivaccination activists on the world wide web. Archives of Disease in Childhood, 87, 22–25. doi:10.1136/adc.87.1.22
19. Del Vicario, M., Bessi, A., Zollo, F., Petroni, F., Scala, A., Caldarelli, G., … Quattrociocchi, W., (2016). The spreading of misinformation online. Proceedings of the National Academy of Sciences, 113(3), 554–559. doi:10.1073/pnas.1517441113
20. Dmitry, B., (2017). Trump warns flu shots are the greatest “scam” in medical history. Retrieved from http://yournewswire.com/trump-flu-shot-scam/%0D
21. Dodds, P. S., & Danforth, C. M., (2010). Measuring the happiness of large-scale written expression: Songs, blogs, and presidents. Journal of Happiness Studies, 11(4), 441–456. doi:10.1007/s10902-009-9150-9
22. Egede, L. E., & Michel, Y., (2006). Medical mistrust, diabetes self-management, and glycemic control in an indigent population with type 2 diabetes. Diabetes Care, 29(1), 131–132. doi:10.2337/diacare.29.01.06.dc05-1642
23. Eysenbach, G., & Kohler, C., (2002). How do consumers search for and appraise health information on the world wide web? Qualitative study using focus groups, usability tests, and in-depth interviews. British Medical Journal, 324, 573–577. doi:10.1136/bmj.324.7337.573
24. Fox, S., (2011). The social life of health information. Pew Internet & American Life Project, 1–33. Retrieved from http://www.pewinternet.org/files/old-media/Files/Reports/2011/PIP_Social_Life_of_Health_Info.pdf
25. Gonzales, A. L., Hancock, J. T., & Pennebaker, J. W., (2010). Language style matching as a predictor of social dynamics in small groups. Communication Research, 37(1), 3–19. doi:10.1177/0093650209351468
26. Greaves, F., Ramirez-Cano, D., Millett, C., Darzi, A., & Donaldson, L., (2013). Use of sentiment analysis for capturing patient experience from free-text comments posted online. Journal of Medical Internet Research, 15(11), e239. doi:10.2196/jmir.2721
27. Gupta, V., & Lehal, G. S., (2009). A survey of text mining techniques and applications. Journal of Emerging Technologies in Web Intelligence, 1(1), 60–76. doi:10.4304/jetwi.1.1.60-76
28. Haelle, T., (2014). Delaying vaccines increases risks—With no added benefits. Retrieved from https://www.scientificamerican.com/article/delaying-vaccines-increases-risks-with-no-added-benefits/
29. Howard, J., (2017). Anti-vaccine groups blamed in Minnesota measles outbreak. Retrieved from http://www.cnn.com/2017/05/08/health/measles-minnesota-somali-anti-vaccine-bn/index.html
30. Jolley, D., & Douglas, K. M., (2014). The effects of anti-vaccine conspiracy theories on vaccination intentions. PLoS ONE, 9(2), e89177. doi:10.1371/journal.pone.0089177
31. Jones, A. M., Omer, S. B., Bednarczyk, R. A., Halsey, N. A., Moulton, L. H., & Salmon, D., (2012). Parents’ source of vaccine information and impact on vaccine attitudes, beliefs, and nonmedical exemptions. Advances in Preventive Medicine, 2012, 1–8. doi:10.1155/2012/932741
32. Kata, A., (2010). A postmodern Pandora’s box: Anti-vaccination misinformation on the Internet. Vaccine, 28(7), 1709–1716. doi:10.1016/j.vaccine.2009.12.022
33. Kata, A., (2012). Anti-vaccine activists, Web 2.0, and the postmodern paradigm - An overview of tactics and tropes used online by the anti-vaccination movement. Vaccine, 30(25), 3778–3789. doi:10.1016/j.vaccine.2011.11.112
34. Kreps, G. L., & Neuhauser, L., (2010). New directions in eHealth communication: Opportunities and challenges. Patient Education and Counseling, 78(3), 329–336. doi:10.1016/j.pec.2010.01.013
35. Lazarus, R. S., (1991). Emotion & adaptation. New York, NY: Oxford University Press.
36. Lewandowsky, S., Ecker, U. K. H., Seifert, C. M., Schwarz, N., & Cook, J., (2012). Misinformation and its correction: Continued influence and successful debiasing. Psychological Science in the Public Interest, 13(3), 106–131. doi:10.1177/1529100612451018
37. Lewandowsky, S., Oberauer, K., & Gignac, G. E., (2013). NASA faked the moon landing —Therefore, (climate) science is a hoax: An anatomy of the motivated rejection of science. Psychological Science, 24(5), 622–633. doi:10.1177/0956797612457686
38. Majumder, M. S., Cohn, E. L., Mekaru, S. R., Huston, J. E., & Brownstein, J. S., (2015). Substandard vaccination compliance and the 2015 measles outbreak. JAMA Pediatrics, 169(5), 494–495. doi:10.1001/jamapediatrics.2015.0384
39. Mazzocut, M., Truccolo, I., Antonini, M., Rinaldi, F., Omero, P., Ferrarin, E., … Tasso, C., (2016). Web conversations about complementary and alternative medicines and cancer: Content and sentiment analysis. Journal of Medical Internet Research, 18(6), e120. doi:10.2196/jmir.5521
40. Mohammad, S. M., (2012). #emotional tweets. Proceedings of the First Joint Conference on Lexical and Computational Semantics–Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (pp. 246–255), Association for Computational Linguistics, Stroudsburg, PA.
41. Mohammad, S. M., & Turney, P. D., (2010). Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. Proceedings of the NAACL-HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text (pp. 26–34), Los Angeles, California.
42. Mohammad, S. M., & Turney, P. D., (2013). Crowdsourcing a word-emotion association lexicon. Computational Intelligence, 29, 436–465. doi:10.1111/j.1467-8640.2012.00460.x
43. Moran, M. B., Lucas, M., Everhart, K., Morgan, A., & Prickett, E., (2016). What makes anti-vaccine websites persuasive? A content analysis of techniques used by anti-vaccine websites to engender anti-vaccine sentiment. Journal of Communication in Healthcare, 9(3), 151–163. doi:10.1080/17538068.2016.1235531
44. Mostafa, M. M., (2013). More than words: Social networks’ text mining for consumer brand sentiments. Expert Systems with Applications, 40(10), 4241–4251. doi:10.1016/j.eswa.2013.01.019
45. Mulroy, Z., (2017). Distraught mum’s powerful vaccination message to parents after baby’s tragic death. Retrieved from http://www.mirror.co.uk/lifestyle/family/distraught-mums-powerful-vaccination-message-9610620
46. Nagler, R. H., (2014). Adverse outcomes associated with media exposure to contradictory nutrition messages. Journal of Health Communication, 19(1), 24–40. doi:10.1080/10810730.2013.798384
47. Newman, M. L., Pennebaker, J. W., Berry, D. S., & Richards, J. M., (2003). Lying words: Predicting deception from linguistic styles. Personality and Social Psychology Bulletin, 29(5), 665–675. doi:10.1177/0146167203029005010
48. Nyhan, B., Reifler, J., Richey, S., & Freed, G. L., (2014). Effective messages in vaccine promotion: A randomized trial. Pediatrics, 133(4), e835–e842. doi:10.1542/peds.2013-2365
49. Omer, S. B., Richards, J. L., Ward, M., & Bednarczyk, R. A., (2012). Vaccination policies and rates of exemption from immunization, 2005–2011. New England Journal of Medicine, 367(12), 1170–1171. doi:10.1056/NEJMc1209037
50. Omer, S. B., Salmon, D. A., Orenstein, W. A., deHart, M. P., & Halsey, N., (2009). Vaccine refusal, mandatory immunization, and the risks of vaccine-preventable diseases. New England Journal of Medicine, 360(19), 1981–1988. doi:10.1056/NEJMsa0806477
51. Ott, M., Choi, Y., Cardie, C., & Hancock, J. T., (2011). Finding deceptive opinion spam by any stretch of the imagination. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1 (pp. 309–319).
52. Pang, B., & Lee, L., (2008). Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 1(2), 91–231.
53. Phadke, V. K., Bednarczyk, R. A., Salmon, D. A., & Omer, S. B., (2016). Association between vaccine refusal and vaccine-preventable diseases in the United States: A review of measles and pertussis. Jama, 315(11), 1149–1158. doi:10.1001/jama.2016.1353
54. Piotrkowicz, A., Dimitrova, V., Otterbacher, J., & Markert, K., (2017, May). The impact of news values and linguistic style on the popularity of headlines on Twitter and Facebook. Proceedings of the Second International Workshop on News and Public Opinion, Association for the Advancement of Artificial Intelligence.
55. Raghunathan, R., & Trope, Y., (2002). Walking the tightrope between feeling good and being accurate: Mood as a resource in processing persuasive messages. Journal of Personality and Social Psychology, 83(3), 510–525. doi:10.1037/0022-3514.83.3.510
56. Rosenthal, S., Ritter, A., Nakov, P., & Stoyanov, V., (2014). SemEval-2014 Task 9: Sentiment analysis in Twitter. Proceedings of the 8th International Workshop on Semantic Evaluation, (pp. 73–80).
57. Salmon, D. A., Moulton, L. H., Omer, S. B., DeHart, M. P., Stokley, S., & Halsey, N. A., (2005). Factors associated with refusal of childhood vaccines among parents of school-aged children: A case-control study. Archives of Pediatrics & Adolescent Medicine, 159(5), 470–476. doi:10.1001/archpedi.159.5.470
58. Silge, J., & Robinson, D., (2017). Text Mining with R: A tidy approach. Boston, MA: O’Reilly Media.
59. Summers, D., (2014). Pediatrician: Vaccinate your kids—Or get out of my office. Retrieved from http://www.thedailybeast.com/articles/2014/01/30/the-real-reason-pediatricians-want-you-to-vaccinate-your-kids.html
60. Wolfe, R. M., & Sharp, L. K., (2005). Vaccination or immunization? The impact of search terms on the internet. Journal of Health Communication, 10(6), 537–551. doi:10.1080/10810730500228847
61. Wolfe, R. M., Sharp, L. K., & Lipsky, M. S., (2002). Content and design attributes of antivaccination web sites. JAMA, 287(24), 3245–3248. doi:10.1001/jama.287.24.3245
62. Wong, C. A., Sap, M., Schwartz, A., Town, R., Baker, T., Ungar, L., & Merchant, R. M., (2015). Twitter sentiment predicts affordable care act marketplace enrollment. Journal of Medical Internet Research, 17(2), e51. doi:10.2196/jmir.3812
63. World Health Organization. (2013). Global action plan for the prevention and control of noncommunicable diseases 2013–2020. Geneva, Switzerland: Author.
64. Xu, Z., & Guo, H., (2017). A meta-analysis of the effectiveness of guilt on health-related attitudes and intentions. Health Communication, 1–7. doi:10.1080/10410236.2017.1278633
65. Younis, E. M. G., (2015). Sentiment analysis and text mining for social media microblogs using open source tools: An empirical study. International Journal of Computer Applications, 112(5), 44–48.
66. Zhou, L., Burgoon, J. K., Nunamaker, J. F., & Twitchell, D., (2004). Automating linguistics-based cues for detecting deception in text-based asynchronous computer-mediated communications. Group Decision and Negotiation, 13(1), 81–106. doi:10.1023/B:GRUP.0000011944.62889.6f
67. Zhou, X., Tao, X., Yong, J., & Yang, Z., (2013). Sentiment analysis on tweets for social events. In Shen, W., Li, W., Barthes, J-P., Luo, J., Zhu, H., Yong, J., Li, X., (Eds.), Proceedings of the 2013 IEEE 17th International Conference on Computer Supported Cooperative Work in Design (pp. 557–562).Piscataway, NJ: IEEE.
68. Zhu, X., Kiritchenko, S., & Mohammad, S. M., (2014, August 23–24). NRC-Canada-2014: Recent improvements in the sentiment analysis of tweets. Proceedings of the Eighth International Workshop on Semantic Evaluation Exercises (SemEval-2014), Dublin, Ireland, pp. 443–447.
69. Zimmerman, R. K., Wolfe, R. M., Fox, D. E., Fox, J. R., Nowalk, M. P., Troy, J. A., & Sharp, L. K., (2005). Vaccine criticism on the world wide web. Journal of Medical Internet Research, 7(2), e17. doi:10.2196/jmir.7.2.e17