Supervised collective classification for crowdsourcing

2015 IEEE Globecom Workshops, GC Wkshps 2015 - Proceedings

Volumn , Issue , 2015, Pages

  Chen, Pin Yu ^a   Lien, Chia Wei ^b   Chu, Fu Jen ^c   Ting, Pai Shun ^a   Cheng, Shin Ming ^d  

^a UNIVERSITY OF MICHIGAN   (United States)

^b AMAZON   (United States)

^c GEORGIA INSTITUTE OF TECHNOLOGY   (United States)

^d NATIONAL TAIWAN UNIVERSITY OF SCIENCE AND TECHNOLOGY   (Taiwan)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; CROWDSOURCING;

CLASSIFICATION ACCURACY; COLLECTIVE CLASSIFICATIONS; SADDLE POINT; SUPERVISED METHODS; TRAINING DATA; UNSUPERVISED METHOD; WEIGHTING FACTORS; WISDOM OF CROWDS;

CLASSIFICATION (OF INFORMATION);

EID: 84971352058     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/GLOCOMW.2015.7414077     Document Type: Conference Paper

References (27)

1. J. Surowiecki, The Wisdom of Crowds. Anchor, 2005
2. R. J. Prill, J. Saez-Rodriguez, L. G. Alexopoulos, P. K. Sorger, and G. Stolovitzky, "Crowdsourcing network inference: The dream predictive signaling network challenge," Science Signaling, vol. 4, no. 189, Sept. 2011
3. D. R. Choffnes, F. E. Bustamante, and Z. Ge, "Crowdsourcing servicelevel network event monitoring," SIGCOMM Comput. Commun. Rev., vol. 40, no. 4, pp. 387-398, Aug. 2010
4. C. Robson, "Using mobile technology and social networking to crowdsource citizen science," Ph.D. dissertation, Berkeley, CA, USA, 2012
5. J. Albors, J. Ramos, and J. Hervas, "New learning network paradigms: Communities of objectives, crowdsourcing, wikis and open source," International Journal of Information Management, vol. 28, no. 3, pp. 194-202, 2008
6. M. Nitti, R. Girau, and L. Atzori, "Trustworthiness management in the social internet of things," IEEE Trans. Knowl. Data Eng., vol. 26, no. 5, pp. 1253-1266, May 2014
7. I.-R. Chen, F. Bao, and J. Guo, "Trust-based service management for social internet of things systems," IEEE Trans. Dependable Secure Comput., vol. PP, no. 99, pp. 1-1, 2015
8. M. Nitti, L. Atzori, and I. Cvijikj, "Friendship selection in the social internet of things: Challenges and possible strategies," IEEE Internet Things J., vol. 2, no. 3, pp. 240-247, June 2015
9. J. Howe, "The rise of crowdsourcing," Wired Magazine, vol. 14, no. 6, 2006
10. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," Journal of the Royal Statistical Society: Series B, vol. 39, pp. 1-38, 1977
11. A. P. Dawid and A. M. Skene, "Maximum likelihood estimation of observer error-rates using the EM algorithm," Journal of the Royal Statistical Society. Series C (Applied Statistics), vol. 28, no. 1, pp. 20-28, 1979
12. V. C. Raykar, S. Yu, L. H. Zhao, G. H. Valadez, C. Florin, L. Bogoni, and L. Moy, "Learning from crowds," J. Mach. Learn. Res., vol. 11, pp. 1297-1322, Aug. 2010
13. D. Zhou, J. Platt, S. Basu, and Y. Mao, "Learning from the wisdom of crowds by minimax entropy," in Advances in Neural Information Processing Systems (NIPS), 2012, pp. 2204-2212
14. O. Dekel and O. Shamir, "Vox populi: Collecting high-quality labels from a crowd," in Proceedings of the 22nd Annual Conference on Learning Theory, 2009
15. S. Ertekin, H. Hirsh, and C. Rudin, "Approximating the wisdom of the crowd," in Advances in Neural Information Processing Systems (NIPS). Workshop on Computational Social Science and the Wisdom of Crowds, 2011
16. P. G. Ipeirotis, F. Provost, and J. Wang, "Quality management on amazon mechanical turk," in Proceedings of the ACM SIGKDD Workshop on Human Computation, 2010, pp. 64-67
17. W. Tang and M. Lease, "Semi-Supervised Consensus Labeling for Crowdsourcing," in Proceedings of the ACM SIGIR Workshop on Crowdsourcing for Information Retrieval (CIR), July 2011, pp. 36-41
18. P. Ipeirotis, F. Provost, V. Sheng, and J. Wang, "Repeated labeling using multiple noisy labelers," Data Mining and Knowledge Discovery, vol. 28, no. 2, pp. 402-441, 2014
19. C. Cortes and V. Vapnik, "Support-vector networks," Mach. Learn., vol. 20, no. 3, pp. 273-297, Sept. 1995
20. K. Crammer and Y. Singer, "On the algorithmic implementation of multiclass kernel-based vector machines," J. Mach. Learn. Res., vol. 2, pp. 265-292, Mar. 2002
21. R. Snow, B. O'Connor, D. Jurafsky, and A. Y. Ng, "Cheap and fast-but is it good?: Evaluating non-expert annotations for natural language tasks," in Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2008, pp. 254-263
22. J. Zhu, S. Rosset, H. Zou, and T. Hastie, "Multi-class AdaBoost," Tech. Rep., 2006
23. T. Hastie, R. Tibshirani, and J. Friedman, The Elements of Statistical Learning, ser. Springer Series in Statistics, 2001
24. N. Littlestone and M. K. Warmuth, "The weighted majority algorithm," Inf. Comput., vol. 108, no. 2, pp. 212-261, Feb. 1994
25. S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, "Distributed optimization and statistical learning via the alternating direction method of multipliers," Found. Trends Mach. Learn., vol. 3, no. 1, pp. 1-122, Jan. 2011
26. S. Boyd and L. Vandenberghe, Convex Optimization. Cambridge University Press, 2004
27. Text REtrieval Conference (TREC) Crowdsourcing Track. National Institute of Standards and Technology (NIST), 2011. [Online]. Available: https://sites.google.com/site/treccrowd/home