Discovering, assessing, and mitigating data bias in social media

Online Social Networks and Media

Volumn 1, Issue , 2017, Pages 1-13

  Morstatter, Fred ^a   Liu, Huan ^a  

^a Arizona State University   (United States)

Author keywords

Data collection; Data collection bias; Data mining; Machine learning; Social data bias; Social media mining; Twitter

Indexed keywords

BEHAVIORAL RESEARCH; DATA ACQUISITION; LEARNING SYSTEMS; PREDICTIVE ANALYTICS; SOCIAL NETWORKING (ONLINE);

DATA COLLECTION; DATA COLLECTION STRATEGIES; INFORMATION DIFFUSION; SOCIAL DATUM; SOCIAL MEDIA MININGS; SOCIAL MEDIA PLATFORMS; TWITTER; VALIDATION RESULTS;

DATA MINING;

EID: 85050187929     PISSN: None     EISSN: 24686964     Source Type: Journal    
DOI: 10.1016/j.osnem.2017.01.001     Document Type: Article

References (27)

1. Campbell, D.G., Egypt Unshackled: Using Social Media to @#:) the System. 2011, Cambria Books, Amherst, NY.
2. Tumasjan, A., Sprenger, T.O., Sandner, P.G., Welpe, I.M., Predicting elections with Twitter: what 140 characters reveal about political sentiment. Proceedings of the International Conference on Weblogs and Social Media, 2010, AAAI, Washington, DC, USA, 178–185.
3. Gayo-Avello, D., Metaxas, P.T., Mustafaraj, E., Limits of electoral predictions using Twitter. Proceedings of the International Conference on Weblogs and Social Media, 2011, AAAI, Barcelona, Spain, 490–493.
4. Tufekci, Z., Big questions for social media big data: representativeness, validity and other methodological pitfalls. Proceedings of the International Conference on Web and Social Media, 2014, 505–514.
5. Duggan, M., Brenner, J., The Demographics of Social Media Users, 2012. 2013, Pew Research Center's Internet & American Life Project.
6. Mislove, A., Lehmann, S., Ahn, Y.-Y., Onnela, J.-P., Rosenquist, J.N., Understanding the demographics of Twitter users. Proceedings of the International Conference on Web and Social Media, 2011.
7. Cook, D.M., Waugh, B., Abdipanah, M., Hashemi, O., Rahman, S.A., Twitter deception and influence:issues of identity, slacktivism, and puppetry. J. Inf. Warf. 13:1 (2014), 1–11.
8. Shen, Y., Yu, J., Dong, K., Nan, K., Automatic fake followers detection in Chinese micro-blogging system. Proceedings of the Pacific-Asia Conference on Knowledge Discovery and Data Mining, 2014, Springer, 596–607.
9. Wang, G., Wilson, C., Zhao, X., Zhu, Y., Mohanlal, M., Zheng, H., Zhao, B.Y., Serf and turf: crowdturfing for fun and profit. Proceedings of the 21st International Conference on World Wide Web, 2012, ACM, 679–688.
10. Ott, M., Cardie, C., Hancock, J., Estimating the prevalence of deception in online review communities. Proceedings of the 21st International Conference on World Wide Web, 2012, ACM, 201–210.
11. Ghosh, S., Zafar, M.B., Bhattacharya, P., Sharma, N., Ganguly, N., Gummadi, K., On sampling the wisdom of crowds: random vs. expert sampling of the Twitter stream. Proceedings of the International Conference on Information and Knowledge Management, 2013, ACM, 1739–1744.
12. Gonzlez-Bailn, S., Wang, N., Rivero, A., Borge-Holthoefer, J., Moreno, Y., Assessing the bias in samples of large online networks. Soc. Netw. 38 (2014), 16–27 http://dx.doi.org/10.1016/j.socnet.2014.01.004.
13. Kergl, D., Roedler, R., Seeber, S., On the endogenesis of Twitter's Spritzer and Gardenhose sample streams. Proceedings of the International Conference on Advances in Social Network Analysis and Mining, 2014, 357–364.
14. Yang, L., Sun, T., Zhang, M., Mei, Q., We know what @you #tag: does the dual role affect hashtag adoption?. Proceedings of the 21st International Conference on World Wide Web, 2012, ACM, New York, NY, USA, 261–270, 10.1145/2187836.2187872.
15. Efron, M., Hashtag retrieval in a microblogging environment. Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 2010, ACM, New York, NY, USA, 787–788, 10.1145/1835449.1835616.
16. Tsur, O., Rappoport, A., What's in a hashtag?: Content based prediction of the spread of ideas in microblogging communities. Proceedings of the fifth ACM International Conference on Web Search and Data Mining, 2012, ACM, New York, NY, USA, 643–652, 10.1145/2124295.2124320.
17. Recuero, R., Araujo, R., On the rise of artificial trending topics in Twitter. Proceedings of the 23rd ACM Conference on Hypertext and Social Media, 2012, ACM, New York, NY, USA, 305–306, 10.1145/2309996.2310046.
18. Agresti, A., Analysis of Ordinal Categorical Data. vol. 656, 2010, Wiley, Hoboken, New Jersey.
19. Morstatter, F., Lubold, N., Pon-Barry, H., Pfeffer, J., Liu, H., Finding eyewitness tweets during crises. ACL 52 (2014), 23–27.
20. Cheng, Z., Caverlee, J., Lee, K., You are where you tweet: a content-based approach to geo-locating Twitter users. Proceedings of the 19th ACM International Conference on Information and Knowledge Management, 2010, ACM, 759–768.
21. Morstatter, F., Kumar, S., Liu, H., Maciejewski, R., Understanding Twitter data with tweetxplorer. Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2013, ACM, 1482–1485.
22. Morstatter, F., Pfeffer, J., Liu, H., When is it biased?: assessing the representativeness of Twitter's streaming API. Proceedings of the International World Wide Web Conference, 2014, 555–556.
23. Efron, B., The Jackknife, The Bootstrap and Other Resampling Plans. 1987, Society for Industrial and Applied Mathematics.
24. Ryan, T.P., Statistical Methods for Quality Improvement. vol. 840, 2011, Wiley.com.
25. Morstatter, F., Pfeffer, J., Liu, H., Carley, K.M., Is the sample good enough? Comparing data from Twitter's Streaming API with Twitter's Firehose. Proceedings of the International Conference on Web and Social Media, 2013, 400–408.
26. Sampson, J., Morstatter, F., Maciejewski, R., Liu, H., Surpassing the limit: keyword clustering to improve Twitter sample coverage. Proceedings of the 26th ACM Conference on Hypertext & Social Media, 2015, ACM, 237–245.
27. Morstatter, F., Dani, H., Sampson, J., Liu, H., Can one tamper with the sample API? Toward neutralizing bias from spam and bot content. Proceedings of the International World Wide Web Conference, 2016.