Big social data analytics in journalism and mass communication: Comparing dictionary-based text analysis and unsupervised topic modeling

Journalism and Mass Communication Quarterly

Volumn 93, Issue 2, 2016, Pages 322-359

  Guo, Lei ^a   Vargo, Chris J ^b   Pan, Zixuan ^c   Ding, Weicong ^d   Ishwar, Prakash ^a  

^a BOSTON UNIVERSITY   (United States)

^b UNIVERSITY OF ALABAMA   (United States)

^c Yodlee   (United States)

^d Technicolor Research   (United States)

Author keywords

Computer assisted content analysis; Political communication; Topic modeling; Twitter; Unsupervised machine learning

Indexed keywords

COMMUNICATION; MACHINE LEARNING; MODELING; SOCIAL MEDIA; UNSUPERVISED CLASSIFICATION;

EID: 84978910441     PISSN: 10776990     EISSN: 2161430X     Source Type: Journal    
DOI: None     Document Type: Article

References (43)

1. Bak, J., Lin, C. Y., & Oh, A. (2014, October 25-29). Self-disclosure topic model for classifying and analyzing Twitter conversations. In B. Pang & W. Daelemans (Eds.), Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (pp. 1986-1996). Doha, Qatar: Association for Computational Linguistics.
2. Beyer, M. A., & Laney, D. (2012). The importance of "big data": A definition. Stamford, CT: Gartner.
3. Blei, D. M., & Lafferty, J. (2006). Correlated topic models. Advances in Neural Information Processing Systems, 18, 147-154.
4. Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent Dirichlet allocation. Journal of Machine Learning Research, 3, 993-1022.
5. Chuang, J., Roberts, M. E., Stewart, B. M., Weiss, R., Tingley, D., Grimmer, J., & Heer, J. (2015). TopicCheck: Interactive alignment for assessing topic model stability. In Y. Weiss, B. Scholkopf, & J. C. Platt (Eds.), Proceedings of NAACL-HLT (pp. 175-184). Cambridge, MA: MIT Press.
6. Connolly-Ahern, C., Ahern, L. A., & Bortree, D. S. (2009). The effectiveness of stratified constructed week sampling for content analysis of electronic news source archives: AP Newswire, Business Wire, and PR Newswire. Journalism & Mass Communication Quarterly, 86, 862-883.
7. Conway, M. (2006). The subjective precision of computers: A methodological comparison with human coding in content analysis. Journalism & Mass Communication Quarterly, 83, 186-200.
8. Goel, S., Anderson, A., Hofman, J., & Watts, D. (2013). The structural virality of online diffusion. Journal of Management Science. Retrieved from http://www.jakehofman.com/inprint/twiral.pdf
9. Hester, J. B., & Dougall, E. (2007). The efficiency of constructed week sampling for content analysis of online news. Journalism & Mass Communication Quarterly, 84, 811-824.
10. Hoffman, M., Bach, F. R., & Blei, D. M. (2010). Online learning for Latent Dirichlet Allocation. In J. D. Lafferty, C. K. I. Williams, J. Shawe-Taylor, R. S. Zemel, & A. Culotta (Eds.), Advances in neural information processing systems (pp. 856-864). Red Hook, NY: Curran Associates.
11. Hong, L., & Davison, B. D. (2010). Empirical study of topic modeling in twitter. In P. Melville, J. Leskovec, & F. Provost (Eds.), Proceedings of the first workshop on social media analytics (pp. 80-88). New York, NY: ACM.
12. Hu, Y., Boyd-Graber, J., Satinoff, B., & Smith, A. (2014). Interactive topic modeling. Machine Learning, 95, 423-469.
13. Kamhawi, R., & Weaver, D. (2003). Mass communication research trends from 1980 to 1999. Journalism & Mass Communication Quarterly, 80, 7-27.
14. Kiousis, S. (2004). Explicating media salience: A factor analysis of New York Times issue coverage during the 2000 US presidential election. Journal of Communication, 54, 71-87.
15. Krippendorff, K. (2004). Reliability in content analysis. Human Communication Research, 30, 411-433.
16. Lacy, S., Duffy, M., Riffe, D., Thorson, E., & Fleming, K. (2010). Citizen journalism web sites complement newspapers. Newspaper Research Journal, 31(2), 34-46.
17. Laney, D. (2001). 3D data management: Controlling data volume, velocity and variety (META Group Research Note). Retrieved from http://blogs.gartner.com/doug-laney/files/2012/01/ad949-3D-Data-Management-Controlling-Data-Volume-Velocity-and-Variety.pdf
18. Leccese, M. (2009). Online information sources of political blogs. Journalism & Mass Communication Quarterly, 86, 578-593.
19. Lewis, S. C., Zamith, R., & Hermida, A. (2013). Content analysis in an era of big data: A hybrid approach to computational and manual methods. Journal of Broadcasting & Electronic Media, 57, 34-52.
20. Lim, K. W., & Buntine, W. (2014). Twitter opinion topic model: Extracting product opinions from tweets by leveraging hashtags and sentiment lexicon. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (pp. 1319-1328). New York, NY: ACM.
21. Lombard, M., Snyder-Duch, J., & Bracken, C. C. (2002). Content analysis in mass communication: Assessment and reporting of intercoder reliability. Human Communication Research, 28, 587-604.
22. Luke, D. A., Caburnay, C. A., & Cohen, E. L. (2011). How much is enough? New recommendations for using constructed week sampling in newspaper content analysis of health stories. Communication Methods and Measures, 5, 76-91.
23. Manning, C., Raghavan, P., & Schütze, H. (2009). Flat clustering. In Introduction to information retrieval (pp. 349-374). New York, NY: Cambridge University Press.
24. McCombs, M. (2014). Setting the agenda (2nd ed.). Cambridge, UK: Polity Press.
25. Mehrotra, R., Sanner, S., Buntine, W., & Xie, L. (2013). Improving LDA topic models for microblogs via tweet pooling and automatic labeling. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (pp. 889-892). New York, NY: ACM.
26. Neuman, R. W., Guggenheim, L., Jang, S. M., & Bae, S. Y. (2014). The dynamics of public attention: Agenda-setting theory meets big data. Journal of Communication, 64, 193-214.
27. Newman, D., Chemudugunta, C., Smyth, P., & Steyvers, M. (2006). Analyzing entities and topics in news articles using statistical topic models. In S. Mehrotra, D. D. Zeng, & H. Chen (Eds.), Intelligence and security informatics (pp. 93-104). Berlin, Germany: Springer.
28. Petrocik, J. R. (1996). Issue ownership in presidential elections, with a 1980 case study. American Journal of Political Science, 40, 825-850.
29. Rajadesingan, A., Zafarani, R., & Liu, H. (2015). Sarcasm detection on Twitter: A behavioral modeling approach. In Proceedings of the Eighth ACM International Conference on Web Search and Data Mining (pp. 97-106). New York, NY: ACM.
30. Řehůřek, R., & Sojka, P. (2010). Software framework for topic modeling with large corpora. In N. Calzolari et al. (Eds.), Proceedings of the LREC 2010 Workshop on New Challenges for NLP Frameworks (pp. 45-50). Valletta: University of Malta.
31. Riffe, D., & Freitag, A. (1997). A content analysis of content analyses: Twenty-five years of Journalism Quarterly. Journalism & Mass Communication Quarterly, 74, 515-524.
32. Riffe, D., Lacy, S., & Fico, F. (2014). Analyzing media messages: Using quantitative content analysis in research. New York, NY: Routledge.
33. Scharkow, M. (2013). Thematic content analysis using supervised machine learning: An empirical evaluation using German online news. Quality & Quantity, 47, 761-773.
34. Stone, P., Dunphy, D. C., Smith, M. S., & Ogilvie, D. M. (1968). The general inquirer: A computer approach to content analysis. Journal of Regional Science, 8, 113-116.
35. Tang, J., Meng, Z., Nguyen, X., Mei, Q., & Zhang, M. (2014). Understanding the limiting factors of topic modeling via posterior contraction analysis. In E. P. Xing & T. Jebara (Eds.), Proceedings of the 31st International Conference on Machine Learning (pp. 190-198). New York, NY: ACM.
36. Tang, J., Zhang, M., & Mei, Q. (2013). One theme in all views: Modeling consensus topics in multiple contexts. In I. S. Dhillon (Eds.), Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining (pp. 5-13). New York, NY: ACM.
37. Titov, I., & McDonald, R. (2008). Modeling online reviews with multi-grain topic models. In W.-Y. Ma, A. Tomkins, & X. Zhang (Eds.), Proceedings of the 17th international conference on World Wide Web (pp. 111-120). New York, NY: ACM.
38. Vargo, C., Guo, L., McCombs, M., & Shaw, D. L. (2014). Network issue agendas on Twitter during the 2012 US presidential election. Journal of Communication, 64, 296-316.
39. Wallach, H. M. (2006). Topic modeling: Beyond bag-of-words. In W. Cohen & A. Moore (Eds.), Proceedings of the 23rd international conference on Machine learning (pp. 977-984). New York, NY: ACM.
40. West, M. D. (Ed.). (2001). Theory, method, and practice in computer content analysis. Westport, CT: Ablex.
41. Xiang, D. (2013). China's image on international English language social media. Journal of International Communication, 19, 252-271.
42. Zamith, R., & Lewis, S. C. (2015). Content analysis and the algorithmic coder: What computational social science means for traditional modes of media analysis. The ANNALS of the American Academy of Political and Social Science, 659, 307-318.
43. Zhao, W. X., Jiang, J., Weng, J., He, J., Lim, E. P., Yan, H., & Li, X. (2011). Comparing twitter and traditional media using topic models. In Advances in information retrieval (pp. 338-349). Berlin, Germany: Springer.