Evaluation without ground truth in social media research

Communications of the ACM

Volumn 58, Issue 6, 2015, Pages 54-60

  Zafarani, Reza ^a   Liu, Huan ^b  

^a ARIZONA STATE UNIVERSITY   (United States)

^b Arizona State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BIOLOGY;

EMAIL MESSAGES; EVALUATION METHODS; GROUND TRUTH; MOST LIKELY; SCIENTIFIC RESEARCHES; SOCIAL MEDIA;

SOCIAL NETWORKING (ONLINE);

EID: 84930148161     PISSN: 00010782     EISSN: 15577317     Source Type: Journal    
DOI: 10.1145/2666680     Document Type: Article

References (22)

1. Agarwal, N., Liu, H., Tang, L., and Yu, P. S. Identifying the influential bloggers in a community. In Proceedings of the 2008 International Conference on Web Search and Data Mining (Stanford, CA, Feb. 11-12). ACM Press, New York, 2008, 207-218.
2. Anagnostopoulos, A., Kumar, R., and Mahdian, M. Influence and correlation in social networks. In Proceedings of the ACM SIGKDD Conference on Knowledge Discovery in Databases (Las Vegas, Aug. 24-28), ACM Press, New York, 2008, 7-15.
3. Barbier, G., Zafarani, R., Gao, H., Fung, G., and Liu, H. Maximizing benefits from crowdsourced data. Computational and Mathematical Organization Theory 18, 3(Sept. 2012), 257-279.
4. Bernard, H. R., Johnsen, E. C., Killworth, P. D., and Robinson, S. Estimating the size of an average personal network and of an event subpopulation: Some empirical results. Social Science Research 20, 2(June 1991), 109-121.
5. Christakis, N. A. and Fowler, J. H. The spread of obesity in a large social network over 32 years. New England Journal of Medicine 357, 4(Nov. 2007), 370-379.
6. Dietterich, T. G. Ensemble methods in machine learning. In Proceedings of the First International Workshop on Multiple Classifier Systems (Cagliari, Italy, June 21-23), Springer, Berlin, 2000, 1-15.
7. Granger, C. W. J. Investigating causal relations by econometric models and cross-spectral methods. Econometrica: Journal of the Econometric Society 37, 3(July 1969), 424-438.
8. Kish, L. Survey Sampling. John Wiley & Sons, Inc., New York, 1965.
9. Klick, J. and Tabarrok, A. Using terror alert levels to estimate the effect of police on crime. Journal of Law and Economics 48, 1(Apr. 2005), 267-279.
10. Kohavi, R., Henne, R. M., and Sommerfield, D. Practical guide to controlled experiments on the Web: Listen to your customers, not to the hippo. In Proceedings of the 13th ACM SIGKDD Conference on Knowledge Discovery in Databases (San Jose, CA, Aug. 12-15). ACM Press, New York, 2007, 959-967.
11. Kohavi, R., Longbotham, R., Sommerfield, D., and Henne, R. M. Controlled experiments on the Web: Survey and practical guide. Data Mining and Knowledge Discovery 18, 1(Feb. 2009), 140-181.
12. Kumar, S., Zafarani, R., and Liu, H. Understanding user migration patterns in social media. In Proceedings of the 25th Conference of the Association for the Advancement of Artificial Intelligence (San Francisco, Aug. 7-11). AAAI, Palo Alto, CA, 2011, 1204-1209.
13. Kurant, M., Gjoka, M., Butts, C. T., and Markopoulou, A. Walking on a graph with a magnifying glass: Stratified sampling via weighted random walks. In Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems (San Jose, CA, June 7-11). ACM Press, New York, 2011, 281-292.
14. La Fond, T. and Neville, J. Randomization tests for distinguishing social influence and homophily effects. In Proceedings of the 19th WWW Conference (Raleigh, NC, Apr. 26-30). ACM Press, New York, 2010, 601-610.
15. Mason, W. and Suri, S. Conducting behavioral research on Amazon's Mechanical Turk. Behavior Research Methods 44, 1(Mar. 2012), 1-23.
16. Morstatter, F., Pfeffer, J., Liu, H., and Carley, K. M. Is the sample good enough? Comparing data from Twitter's streaming API with Twitter's firehose. In Proceedings of the Seventh International Conference on Weblogs and Social Media (Cambridge, MA, July 8-11). AAAI Press, Palo Alto, CA, 2013, 400-408.
17. Newman, M. E. J. Modularity and community structure in networks. Proceedings of the National Academy of Sciences 103, 23(June 2006), 8577-8582.
18. Papagelis, M., Das, G., and Koudas, N. Sampling online social networks. IEEE Transactions on Knowledge and Data Engineering 25, 3(Mar. 2013), 662-676.
19. Tan, P. N., Steinbach, M., and Kumar, V. Introduction to Data Mining. Pearson Addison-Wesley, Boston, MA, 2006.
20. Yang, J. and Leskovec, J. Defining and evaluating network communities based on ground truth. Knowledge and Information Systems 42, 1(Jan. 2015), 181-213.
21. Yang, T., Chi, Y., Zhu, S., Gong, Y., and Jin, R. Detecting communities and their evolutions in dynamic social networks a Bayesian approach. Machine Learning 82, 2(Feb. 2011), 157-189.
22. Zafarani, R., Abbasi, M. A., and Liu, H. Social Media Mining: An Introduction. Cambridge University Press, New York, 2014.