Digital Trace Data in the Study of Public Opinion: An Indicator of Attention Toward Politics Rather Than Political Support

Social Science Computer Review

Volumn 35, Issue 3, 2017, Pages 336-356

  Jungherr, Andreas ^a   Schoen, Harald ^a   Posegga, Oliver ^b   Jürgens, Pascal ^c  

^a UNIVERSITY OF MANNHEIM   (Germany)

^b UNIVERSITY OF BAMBERG   (Germany)

^c JOHANNES GUTENBERG UNIVERSITY   (Germany)

Author keywords

computational social science; digital trace data; electoral predictions; mediation of politics; public opinion; Twitter

Indexed keywords

EID: 85019623369     PISSN: 08944393     EISSN: 15528286     Source Type: Journal    
DOI: 10.1177/0894439316631043     Document Type: Article

References (66)

1. Adcock R., Collier D., (2001). Measurement validity: A shared standard for qualitatitve and quantitative research. The American Political Science Review, 95, 529–546.
2. Asur S., Huberman B. A., (2010). Predicting the future with social media. In Huang X. J., King I., Raghavan V., Rueger S., (Eds.), WI-IAT 2010: Proceedings of the 2010 IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology (pp. 492–499). Washington, DC: IEEE.
3. Barberá P., Rivero G., (2014). Understanding the political representativeness of twitter users. Social Science Computer Review. Retrieved from http://ssc.sagepub.com/content/early/2014/11/27/0894439314558836.abstract
4. Bermingham A., Smeaton A. F., (2011). On using Twitter to monitor political sentiment and predict election results. In Bandyopadhyay S., Okumura M., SAAIP: Proceedings of the workshop sentiment analysis where AI meets psychology at the international joint conference for natural language processing (IJCNLP) (pp. 2–10). Chiang Mai, Thailand: Asian Federation of Natural Language Processing.
5. Bollen J., Mao H., Zeng X. J., (2011). Twitter mood predicts the stock market. Journal of Computational Science, 2, 1–8.
6. Carmines E. G., Zeller R. A., (1979). Reliability and validity assessment. Beverly Hills, CA: Sage.
7. Ceron A., Curini L., Iacus S. M., (2014). Every tweet counts? How sentiment analysis of social media can improve our knowledge of citizens’ political preferences with an application to Italy and France. New Media & Society, 16, 340–358.
8. Ceron A., Curini L., Iacus S. M., (2015). Using sentiment analysis to monitor electoral campaigns: Method matters—evidence from the United States and Italy. Social Science Computer Review, 33, 3–20.
9. Chaffee S. H., Metzger M. J., (2001). The end of mass communication? Mass Communication & Society, 4, 365–379.
10. Chakrabarti D., Punera K., (2011). Event summarization using tweets. In ICWSM 2011: Proceedings of the 5th international AAAI conference on weblogs and social media (pp. 66–73). Menlo Park, CA: Association for the Advancement of Artificial Intelligence (AAAI).
11. Choi H., Varian H. R., (2009). Predicting the present with google trends. Mountain View, CA: Google Inc. Retrieved from http://static.googleusercontent.com/media/www.google.com/de//googleblogs/pdfs/google_predicting_the_present.pdf
12. Contractor D., Faruquie T. A., (2013). Understanding election candidate approval ratings using social media data. In Schwabe D., Almeida V., Glaser H., Baeza-Yates R., Moon S., (Eds.), WWW 2013: Proceedings of the 22nd international conference on World Wide Web (pp. 189–190). Geneva, Switzerland: International World Wide Web Conferences Steering Committee.
13. Cronbach L. J., Meehl P. E., (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281–302.
14. Diaz F., Gamon M., Hofman J., Kıcıman E., Rothschild D., (2014). Online and social media data as a flawed continuous panel survey. Microsoft Research Working Paper. Retrieved from http://research.microsoft.com/en-us/UM/redmond/projects/flawedsurvey/flawedsurvey.pdf
15. DiGrazia J., McKelvey K., Bollen J., Rojas F., (2013). More tweets, more votes: Social media as a quantitative indicator of political behavior. PLoS One, 8, e79449.
16. Duggan M., Smith A., (2013). Social media update. Pew Internet & American Life Project. Retrieved from http://pewinternet.org/Reports/2013/Social-Media-Update.aspx
17. Fink C., Bos N., Perrone A., Liu E., Kopecky J., (2013). Twitter, public opinion, and the 2011 Nigerian Presidential election. In Bilof R., (Ed.), SocialCom 2013: The 5th IEEE international conference on social computing (pp. 311–320). Washington, DC: IEEE.
18. 2: 2010 UK election prediction with social media. Journal of Information Technology & Politics, 10, 57–71.
19. Gaurav M., Srivastava A., Kumar A., Miller S., (2013). Leveraging candidate popularity on Twitter to predict election outcome. In Grossman R. L., Uthurusamy R., (Eds.), SNAKDD 2013: Proceedings of the 7th workshop on social network mining and analysis (Article no. 7). New York, NY: ACM.
20. Gayo-Avello D., (2011). Don’t turn social media into another ‘Literary Digest’ poll. Communications of the ACM, 54, 121–128.
21. Gayo-Avello D., (2012). No, you cannot predict elections with Twitter. IEEE Internet Computing, 16, 91–94.
22. Gayo-Avello D., (2013). A meta-analysis of state-of-the-art electoral prediction from Twitter data. Social Science Computer Review, 31, 649–679.
23. Gerring J., (2012). Social science methodology (2nd ed.). New York, NY: Cambridge University Press.
24. Ginsberg J., Mohebbi M. H., Patel R. S., Brammer L., Smolinski M. S., Brilliant L., (2009). Detecting influenza epidemics using search engine query data. Nature, 457, 1012–1014.
25. González-Bailón S., Paltoglou G., (2015). Signals of public opinion in online communication: A comparison of methods and data sources. The ANNALS of the American Academy of Political and Social Science, 659, 95–107.
26. Hand D. J., (2004). Measurement theory and practice. London, UK: Wiley.
27. Hopkins D., King G., (2010). A method of automated nonparametric content analysis for social science. American Journal of Political Science, 54, 229–247.
28. Howison J., Wiggins A., Crowston K., (2011). Validity issues in the use of social network analysis with digital trace data. Journal of the Association for Information Systems, 12, 767–797.
29. Huberty M., (2015). Can we vote with our tweet? On the perennial difficulty of election forecasting with social media. International Journal of Forecasting, 31, 992–1007.
30. Hyndman R. J., Koehler A. B., (2006). Another look at measures of forecast accuracy. International Journal of Forecasting, 22, 679–688.
31. Jensen M. J., Anstead N., (2013). Psephological investigations: Tweets, votes, and unknown unknowns in the republican nomination process. Policy & Internet, 5, 161–182.
32. Jungherr A., (2013). Tweets and votes, a special relationship: The 2009 federal election in Germany. In Weber I., Popesc A. M., Pennacchiotti M., (Eds.), PLEAD 2013: Proceedings of the 2nd workshop politics, elections and data (pp. 5–14). New York, NY: ACM.
33. Jungherr A., (2014). The logic of political coverage on Twitter: Temporal dynamics and content. Journal of Communication, 64, 239–259.
34. Jungherr A., (2015). Analyzing political communication with digital trace data: The role of Twitter messages in social science research. Heidelberg, Germany: Springer.
35. Jungherr A., Jürgens P., Schoen H., (2012). Why the pirate party won the German election of 2009 or the trouble with predictions: A response to Tumasjan, A., Sprenger, T.O., Sander, P.G. & Welpe, I.M. “Predicting elections with Twitter: what 140 characters reveal about political sentiment.”” Social Science Computer Review, 30, 229–234.
36. Jungherr A., Schoen H., Jürgens P., (2016). The mediation of politics through Twitter: An analysis of messages posted during the campaigns for the German federal elections 2009 and 2013. Journal of Computer-mediated Communication, 21, 50–68.
37. Kane M. T., (1992). An argument-based approach to validity. Psychological Bulletin, 112, 527–535.
38. Lazer D., Kennedy R., King G., Vespignani A., (2014). The parable of Google flu: Traps in big data analysis. Science, 343, 1203–1205.
39. Lazer D., Pentland A., Adamic L., Aral S., Barabási A. L., Brewer D., …Alstyne M. V., (2009). Computational social science. Science, 323, 721–723.
40. Lin Y. R., Margolin D., Keegan B., Lazer D., (2013). Voices of victory: A computational focus group framework for tracking opinion shift in real time. In Schwabe D., Almeida V., Glaser H., Baeza-Yates R., Moon S., (Eds.), WWW 2013: Proceedings of the 22nd international world wide web conference (pp. 737–748). Geneva, Switzerland: International World Wide Web Conferences Steering Committee.
41. MacKuen M. B., Erikson R. S., Stimson J. A., (1989). Macropartisanship. American Political Science Review, 83, 1125–1142.
42. Marchetti-Bowick M., Chambers N., (2012). Learning for microblogs with distant supervision: Political forecasting with Twitter. In Daelemans W., (Ed.), EACL ‘12: Proceedings of the 13th conference of the European chapter of the association for computational linguistics (pp. 603–612). Stroudsburg, PA: Association for Computational Linguistics.
43. Margolis M., Resnick D., (2000). Politics as usual: The Cyberspace “revolution.” Thousand Oaks, CA: Sage.
44. McKelvey K., DiGrazia J., Rojas F., (2014). Twitter publics: How online political communities signal electoral outcomes in the 2010 U.S. House election. Information, Communication & Society, 17, 436–450.
45. Messick S., (1989). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18, 5–11.
46. Metaxas P. T., Mustafaraj E., Gayo-Avello D., (2011). How (not) to predict elections. In Vinciarelli A., Pantic M., Bertino E., Zhan J., (Eds.), SocialCom 2011: The 3rd IEEE international conference on social computing (pp. 165–171). Washington, DC: IEEE.
47. Murphy J., Link M. W., Childs J. H., Tesfaye C. L., Dean E., Stern M., …Harwood P., (2014). Social media in public opinion research: Executive summary of the aapor task force on emerging technologies in public opinion research. Public Opinion Quarterly, 78, 788–794.
48. O’Connor B., Balasubramanyan R., Routledge B. R., Smith N. A., (2010). From tweets to polls: Linking text sentiment to public opinion time series. In Hearst M., Cohen W., Gosling S., (Eds.), ICWSM 2010: Proceedings of the 4th international AAAI conference on weblogs and social media. Menlo Park, CA: Association for the Advancement of Artificial Intelligence (AAAI).
49. Rainie L., Smith A., Schlozman K. L., Brady H., Verba S., (2012). Social media and political engagement. Pew Internet & American Life Project. Retrieved from http://pewinternet.org/Reports/2012/Political-engagement.aspx
50. R Core Team. (2014). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Retrieved from http://www.R-project.org
51. Ruths D., Pfeffer J., (2014). Social media for large studies of behavior. Science, 346, 1063–1064.
52. Sakaki T., Okazaki M., Matsuo Y., (2010). Earthquake shakes twitter users: Real-time event detection by social sensors. In Rappa M., Jones P., Freire J., Chakrabarti S., (Eds.), WWW 2010: Proceedings of the 19th international conference on the World Wide Web (pp. 851–860). New York, NY: ACM.
53. Sartori G., (1970). Concept misformation in comparative politics. The American Political Science Review, 64, 1033–1053.
54. Schoen H., Gayo-Avello D., Metaxas P. T., Strohmaier M., Gloor P., (2013). The power of prediction with social media. Internet Research, 23, 528–543.
55. Skoric M., Poor N., Achananuparp P., Lim E. P., Jiang J., (2012). Tweets and votes: A study of the 2011 Singapore general election. In Sprague R. H., Jr (Ed.), HICSS 2012: Proceedings of the 45th Hawaii international conference on system science (pp. 2583–2591). Washington, DC: IEEE Computer Society.
56. Soler J. M., Cuartero F., Roblizo M., (2012). Twitter as a tool for predicting elections results. In Karray F., Polat F., (Eds.), ASONAM 2012: IEEE/ACM international conference on advances in social networks analysis and mining (pp. 1194–1200). Los Alamitos, CA: IEEE Press.
57. Thapen N. A., Ghanem M. M., (2013). Towards passive political opinion polling using Twitter. In Cocea M., Gabe M., Wiratunga N., Göker A., (Eds.), Proceedings of the BCS SGAI workshop on social media analysis 2013 (pp. 19–34). Aberdeen, UK: School of Computing Science and Digital Media, Robert Gordon University.
58. Tjong E., Sang K., Bos J., (2012). Predicting the 2011 Dutch Senate election results with Twitter. In Proceedings of the workshop on semantic analysis in social media (pp. 53–60). Stroudsburg, PA: Association for Computational Linguistics.
59. Tourangeau R., Rips L. J., Rasinski K., (2000). The psychology of survey response. Cambridge, England: Cambridge University Press.
60. Tsakalidis A., Papadopoulos S., Cristea A. I., Kompatsiaris Y., (2015). Predicting elections for multiple countries using Twitter and polls. IEEE Intelligent Systems, 30, 10–17.
61. Tumasjan A., Sprenger T. O., Sandner P. G., Welpe I. M., (2010). Predicting elections with Twitter: What 140 characters reveal about political sentiment. In Hearst M., Cohen W., Gosling S., (Eds.), ICWSM 2010: Proceedings of the 4th international AAAI conference on weblogs and social media (pp. 178–185). Menlo Park, CA: Association for the Advancement of Artificial Intelligence (AAAI).
62. Vaccari C., Valeriani A., Barberá P., Bonneau R., Jost J. T., Nagler J., Tucker J., (2013). Social media and political communication: A survey of Twitter users during the 2013 Italian general election.” Rivista Italiana di Scienza, 43, 325–55.
63. Wang W., Rothschild D., Goel S., Gelman A., (2014). Forecasting elections with non-representative polls. International Journal of Forecasting. Retrieved from http://www.sciencedirect.com/science/article/pii/S0169207014000879
64. Whiteley P., Clarke H. D., Sanders D., Stewart M. C., (2013). Affluence, austerity and electoral change in Britain. Cambridge, England: Cambridge University Press.
65. Wickham H., (2009). ggplot2: Elegant graphics for data analysis. New York, NY: Springer.
66. All links were accessible on October 18, 2015