Toward a mixed-methods research approach to content analysis in the digital age: The combined content-analysis model and its applications to health care twitter feeds

Journal of Medical Internet Research

Volumn 18, Issue 3, 2016, Pages

  Hamad, Eradah O ^a,b   Savundranayagam, Marie Y ^b   Holmes, Jeffrey D ^b   Kinsella, Elizabeth Anne ^b   Johnson, Andrew M ^b  

^a KING ABDULAZIZ UNIVERSITY   (Saudi Arabia)

^b UNIVERSITY OF WESTERN ONTARIO   (Canada)

Author keywords

Coding; Computer aided content analysis; Content analysis; Digital disease detection; Health care social media; Health care tweets; Infodemiology; Infoveillance; Mixed methods research; Twitter feeds

Indexed keywords

HUMAN; INFORMATION PROCESSING; INFORMATION RETRIEVAL; METHODOLOGY; RESEARCH; SOCIAL MEDIA;

DATA COLLECTION; HUMANS; INFORMATION STORAGE AND RETRIEVAL; RESEARCH; RESEARCH DESIGN; SOCIAL MEDIA;

EID: 84962069670     PISSN: None     EISSN: 14388871     Source Type: Journal    
DOI: 10.2196/jmir.5391     Document Type: Article

References (55)

1. Kondracki NL, Wellman NS, Amundson DR. Content analysis: review of methods and their applications in nutrition education. J Nutr Educ Behav 2002;34(4):224-230. [Medline: 12217266]
2. Duncan DF. Content analysis in health education research: an introduction to purposes and methods. Health Educ 1989 Dec;20(7):27-31. [Medline: 2516070]
3. Neuendorf KA. Content analysis: a methodological primer for gender research. Sex Roles 2010 Nov 20;64(3-4):276-289. [doi: 10.1007/s11199-010-9893-0]
4. Elo S, Kaariainen M, Kanste O, Polkki T, Utriainen K, Kyngas H. Qualitative content analysis: a focus on trustworthiness. SAGE Open 2014 Feb 11;4(1):1-10. [doi: 10.1177/2158244014522633]
5. White MD, Marsh EE. Content analysis: a flexible methodology. Library Trends 2006;55(1):22-45. [doi: 10.1353/lib.2006.0053]
6. Schreier M. Qualitative Content Analysis in Practice. Thousand Oaks, CA: Sage Publications, Inc; 2012.
7. Krippendorff K. Content Analysis: An Introduction to Its Methodology. Thousand Oaks, CA: Sage Publications, Inc; 2013.
8. Cohen L, Manion L, Morrison K. Research Methods in Education. 7th edition. New York, NY: Routledge/Taylor & Francis; 2011.
9. Holsti OR. Content Analysis for the Social Sciences and Humanities. Reading, MA: Addison-Wesley; 1969.
10. Cartwright D. Analysis of qualitative material. In: Festinger L, Katz D, editors. Research Methods in the Behavioral Sciences. New York: Dryden Press; 1953:421-470.
11. Berelson B. Content Analysis in Communications Research. New York: Macmillan Pub Co; 1971.
12. Smith M, Heady RB, Hamilton JB, Carson PP. Swift: a software program for the analysis of written comments. J Educ Bus 1996 Aug;71(6):354-358. [doi: 10.1080/08832323.1996.10116812]
13. Morgan DL. Qualitative content analysis: a guide to paths not taken. Qual Health Res 1993 Feb 01;3(1):112-121. [doi: 10.1177/104973239300300107]
14. Kracauer S. The challenge of qualitative content analysis. Public Opin Q 1952;16(4):631-642. [doi: 10.1086/266427]
15. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs 2008 Apr;62(1):107-115. [doi: 10.1111/j.1365-2648.2007.04569.x] [Medline: 18352969]
16. Wiedemann G. Opening up to big data: computer-assisted analysis of textual data in social sciences. Forum Qual Soc Res 2013;14(2):Art. 13 [FREE Full text] [WebCite Cache]
17. Krippendorff K. Content Analysis: An Introduction to its Methodology. 2nd edition. Thousand Oaks, CA: Sage Publications, Inc; 2004.
18. Pool IDS, editor. Trends in Content Analysis. Urbana, IL: Uinversity of Illinois Press; 1959.
19. Bryman A. Social Research Methods. 4th edition. New York, NY: Oxford University Press; 2012.
20. Hsieh H, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res 2005 Nov;15(9):1277-1288. [doi: 10.1177/1049732305276687] [Medline: 16204405]
21. Juvani S, Isola A, Kyngäs H. The northern physical environment and the well-being of the elderly aged over 65 years. Int J Circumpolar Health 2012 Mar 18;64(3):246-256. [doi: 10.3402/ijch.v64i3.17988]
22. Latvala E, Janhonen S, Moring J. Passive patients: a challenge to psychiatric nurses. Perspect Psychiatr Care 2000;36(1):24-32. [Medline: 12035671]
23. Rabow MW, Hardie GE, Fair JM, McPhee SJ. End-of-life care content in 50 textbooks from multiple specialties. JAMA 2000 Feb 9;283(6):771-778. [Medline: 10683056]
24. Kirchhoff KT, Beckstrand RL, Anumandla PR. Analysis of end-of-life content in critical care nursing textbooks. J Prof Nurs 2003;19(6):372-381. [Medline: 14689394]
25. Chew C, Eysenbach G. Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. PLoS One 2010 Nov;5(11):e14118 [FREE Full text] [doi: 10.1371/journal.pone.0014118] [Medline: 21124761]
26. Myslín M, Zhu S, Chapman W, Conway M. Using twitter to examine smoking behavior and perceptions of emerging tobacco products. J Med Internet Res 2013 Aug;15(8):e174 [FREE Full text] [doi: 10.2196/jmir.2534] [Medline: 23989137]
27. Scanfeld D, Scanfeld V, Larson EL. Dissemination of health information through social networks: twitter and antibiotics. Am J Infect Control 2010 Apr;38(3):182-188 [FREE Full text] [doi: 10.1016/j.ajic.2009.11.004] [Medline: 20347636]
28. Heaivilin N, Gerbert B, Page JE, Gibbs JL. Public health surveillance of dental pain via Twitter. J Dent Res 2011 Sep;90(9):1047-1051 [FREE Full text] [doi: 10.1177/0022034511415273] [Medline: 21768306]
29. Robillard JM, Johnson TW, Hennessey C, Beattie BL, Illes J. Aging 2.0: health information about dementia on Twitter. PLoS One 2013 Jul;8(7):e69861 [FREE Full text] [doi: 10.1371/journal.pone.0069861] [Medline: 23922827]
30. Rachel HM, Margaret KA, Morgaine KC, Antoun JS, Farella M. A qualitative analysis of orthodontic-related posts on Twitter. Angle Orthod 2014 Mar;84(2):203-207. [doi: 10.2319/051013-355.1] [Medline: 23984992]
31. Signorini A, Segre AM, Polgreen PM. The use of Twitter to track levels of disease activity and public concern in the U.S. during the influenza A H1N1 pandemic. PLoS One 2011 May;6(5):e19467 [FREE Full text] [doi: 10.1371/journal.pone.0019467] [Medline: 21573238]
32. Bosley JC, Zhao NW, Hill S, Shofer FS, Asch DA, Becker LB, et al. Decoding twitter: Surveillance and trends for cardiac arrest and resuscitation communication. Resuscitation 2013 Feb;84(2):206-212 [FREE Full text] [doi: 10.1016/j.resuscitation.2012.10.017] [Medline: 23108239]
33. Hanson CL, Cannon B, Burton S, Giraud-Carrier C. An exploration of social circles and prescription drug abuse through Twitter. J Med Internet Res 2013 Sep;15(9):e189 [FREE Full text] [doi: 10.2196/jmir.2741] [Medline: 24014109]
34. Rui JR, Chen Y, Damiano A. Health organizations providing and seeking social support: a Twitter-based content analysis. Cyberpsychol Behav Soc Netw 2013 Sep;16(9):669-673. [doi: 10.1089/cyber.2012.0350] [Medline: 23786172]
35. Zhang N, Campo S, Janz KF, Eckler P, Yang J, Snetselaar LG, et al. Electronic word of mouth on twitter about physical activity in the United States: exploratory infodemiology study. J Med Internet Res 2013 Nov;15(11):e261 [FREE Full text] [doi: 10.2196/jmir.2870] [Medline: 24257325]
36. Park H, Rodgers S, Stemmle J. Analyzing health organizations' use of Twitter for promoting health literacy. J Health Commun 2013 Apr;18(4):410-425. [doi: 10.1080/10810730.2012.727956] [Medline: 23294265]
37. Manning ML, Davis J. Journal Club: Twitter as a source of vaccination information: content drivers and what they're saying. Am J Infect Control 2013 Jun;41(6):571-572. [doi: 10.1016/j.ajic.2013.02.003] [Medline: 23726549]
38. Jashinsky J, Burton SH, Hanson CL, West J, Giraud-Carrier C, Barnes MD, et al. Tracking suicide risk factors through Twitter in the US. Crisis 2014 Oct;35(1):51-59. [doi: 10.1027/0227-5910/a000234] [Medline: 24121153]
39. McNeil K, Brna PM, Gordon KE. Epilepsy in the Twitter era: a need to re-tweet the way we think about seizures. Epilepsy Behav 2012 Feb;23(2):127-130. [doi: 10.1016/j.yebeh.2011.10.020] [Medline: 22134096]
40. Sullivan SJ, Schneiders AG, Cheang C, Kitto E, Lee H, Redhead J, et al. 'What's happening?' A content analysis of concussion-related traffic on Twitter. Br J Sports Med 2012 Mar;46(4):258-263. [doi: 10.1136/bjsm.2010.080341] [Medline: 21406451]
41. Donelle L, Booth R. Health tweets: an exploration of health promotion on twitter. Online J Issues Nurs 2012 Sep;17(3):4 [FREE Full text] [Medline: 23036060]
42. Lyles CR, López A, Pasick R, Sarkar U. "5 mins of uncomfyness is better than dealing with cancer 4 a lifetime": an exploratory qualitative analysis of cervical and breast cancer screening dialogue on Twitter. J Cancer Educ 2013 Mar;28(1):127-133. [doi: 10.1007/s13187-012-0432-2] [Medline: 23132231]
43. Neuendorf K. The Content Analysis Guidebook. Thousand Oaks, CA: Sage Publications Ltd; 2002.
44. Lewins A, Silver C. Using Software in Qualitative Research: A Step-by-Step Guide. London: SAGE Publications, Inc; 2014.
45. Thoren EM, Metze B, Bührer C, Garten L. Online support for parents of preterm infants: a qualitative and content analysis of Facebook 'preemie' groups. Arch Dis Child Fetal Neonatal Ed 2013 Nov;98(6):F534-F538. [doi: 10.1136/archdischild-2012-303572] [Medline: 23759520]
46. McMillan SJ. The microscope and the moving target: the challenge of applying content analysis to the World Wide Web. J Mass Commun Q 2000 Mar 01;77(1):80-98. [doi: 10.1177/107769900007700107]
47. Heaivilin N, Gerbert B, Page JE, Gibbs JL. Public health surveillance of dental pain via Twitter. J Dent Res 2011 Sep;90(9):1047-1051 [FREE Full text] [doi: 10.1177/0022034511415273] [Medline: 21768306]
48. Creswell JW, Clark VLP, Gutmann M, Hanson WE. Advanced mixed methods research designs. In: Tashakkori A, Teddlie C, editors. Handbook of Mixed Methods in the Social & Behavioral Research. Thousand Oaks, CA: Sage Publications, Inc; 2003:209-240.
49. Healthcare Hashtag Project: Healthcare Tweet Chats.: Symplur LLC; 2016. URL: http://www.symplur.com/healthcare-hashtags/tweet-chats/ [accessed 2016-02-19] [WebCite Cache ID 6fQcDELmo]
50. Honeycutt C, Herring S. Proceedings of the Forty-Second Hawaii International Conference on System Sciences (HICSS-42). New York: IEEE Press; 2009 Jan 5. Beyond microblogging: Conversation and collaboration via Twitter URL: http://ella. slis.indiana.edu/~herring/honeycutt.herring.2009.pdf [WebCite Cache ID 6fm5Vk4k1]
51. Gruzd A, Haythornthwaite C. Enabling community through social media. J Med Internet Res 2013 Oct;15(10):e248 [FREE Full text] [doi: 10.2196/jmir.2796] [Medline: 24176835]
52. Guba E, Lincoln Y. Epistemological and methodological bases of naturalistic inquiry. Educ Commun Technol J 1982;30(4):233-252 [FREE Full text] [doi: 10.1007/BF02765185]
53. Russell M. Mining the Social WebData Mining from Facebook, Twitter, and LinkedIn, Google+, GitHub, and More. Sebastopol, CA: O'Reilly Media, Inc; 2013.
54. Lewis SC, Zamith R, Hermida A. Content analysis in an era of big data: a hybrid approach to computational and manual methods. J Broadcasting Electronic Media 2013 Jan;57(1):34-52. [doi: 10.1080/08838151.2012.761702]
55. Zamith R, Lewis SC. Content analysis and the algorithmic coder: what computational social science means for traditional modes of media analysis. Ann Am Acad Polit Soc Sci 2015 Apr 09;659(1):307-318. [doi: 10.1177/0002716215570576]